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This  handbook  provides  detailed  Instructions  (together  with  Illustrative 
numerical  examples)  for  implementing  various  methodologies  designed  to  provide  a 
Prd^ram  Manager  with  analytical  tools  for  solving  various  problems  encountered 
during  system  development.  The  management  tools  are  applicable  to  nearly  er.> 
system  ranging  from  a simple  combination  of  a few  subsystems  to  a complex  air- 
craft. Briefly  stated,  these  tools  allow  for  continuous  and  systematic  evalua- 
tion of  overall  system  reliability,  optimal  allocation  of  resources  in  system 
reliability  improvement  programs,  and  optimal  allocation  of  resources  In  system 
effectiveness  Improvement  programs. 


The  first  two  sections  of  the  handbook  are  Intended  to  show  the  potential 
of  the  methodology  to  the  Program  Olrector.  The  following  sections  describe  the 
models  and  the  step-by-step  procedures  for  their  use  so  that  program  personnel 
can  understand  the  mechanics  and  apply  the  methodology  to  their  particular 
program.  Rather  than  develop  rigorous  mathematical  proof  for  the  models, 
numerical  examples  were  used  to  show  how  to  Implement  the  methodology.  The 
examples  also  Indicate  that  Input  data  are  available  using  engineering  estimates 
and  historical  results  of  "like"  subsystems  In  the  co.iceptual  phase.  Then,  as 
test  results  become  available  In  the  validation  and  full  scale  development 
phases  the  data  base  Is  continuously  Improved.  r 
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A.  GENERAL 


In  June  of  1973,  Deputy  Secretary  of  Defense  William  P.  Clements,  Jr.  Issued 
a memorandum  to  the  secretaries  of  the  military  departments  and  the  Defense 
Systems  Acquisition  Review  Council  (DSARC)  to  establish  Design  to  Cost  (DTC) 
goals  for  major  defense  system  programs.  This  memorandum  began  a major  first 
step  in  DTC  Implementation.  The  DTC  concept  Is  defined  as  "the  establishment 
of  cost  goals  early  In  the  development  process  and  the  management  and  control  of 
future  acquisition,  operating  and  support  costs  to  these  goals  by  the  conduct 
of  practical  tradeoffs  between  system  capabilities,  cost,  and  schedule."  Although 
the  DOD  DTC  concept  Is  quite  clear.  It  does  not  provide  specific  guidance  In 
establishing  techniques  for  Implementing  DOD  DTC  policies.  This  handbook  presents 
an  approach  for  translating  some  of  the  DOD  DTC  policies  Into  effective  management 
tools.  These  management  tools  address  the  tradeoffs  between  systen  capability  and 
cost  but  do  not  consider  tradMffs  involving  schedule.  Furthermore,  to  place  this 
methodology  In  proper  context.  It  is  necessary  to  discuss  system  capability  In 
terms  of  performance  levels  related  to  mission  requirements.  For  any  system 
there  are  certain  performance  specifications,  e.g.,  speed,  range,  accuracy,  etc., 
which  must  be  met.  After  these  specifications  have  been  met,  how  well  a system 
performs  Its  mission  Is  strictly  a function  of  l^s  Inherent  reliability  and 
effectiveness.  Therefore,  In  this  handbook,  the  system  capability  tradeoffs  are 
In  terms  of  performance  and  effectiveness  where  performance  Is  ..teasured  by  mission 
reliability. 

The  management  of  any  system  program  Is  a continuous.  Iterative  process. 
Throughout  the  system  development,  design  changes  In  various  subsystems  are  pro- 
posed while  the  accuracy  of  cost  estimates  as  well  as  reliability  estimates  are 
being  improved.  To  effectively  manage  a program  and  meet  DTC  goals.  It  is 
necessary  that  the  Program  Manager  have  a tlrely  feedback  of  current  cost  and 
performance  estimates  of  all  proposed  subsystem  options.  On  a day-by-day  basis, 
the  Program  Manager  should  have  the  means  to: 
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• Evaluate  current  progress  of  system  development. 


• Identify  problem  areas  associated  with  various  subsystems  where 
corrective  actions  or  additional  subsystem  options  are  required. 

• Identify  subsystems  whose  performance  levels  are  more  than 
adequate  to  meet  mission  requirements  and  investigate  if  these  subsystems  can 
be  replaced  by  lower  cost  subsystems  (which  generally  implies  lower  performance) 
with  the  cost  savings  invested  more  effectively  in  the  improvement  of  other  more 
critical  subsystems,  i.e.,  optimal  allocation  of  resources. 

• Select  the  combination  of  subsystem  options  yielding  the 
maximum  total  system  performance  achievable  at  the  DTC  goal. 

• Evaluate  the  effect  of  any  proposed  change  in  system  design  and 

its  impact  on  DTC  goals.  . 

The  management  tools  described  in  this  handbook  furnish  a Program  Manager  with  a 
simple  means  to  address  these  objectives  by  providing  a systematic  and  standardized 
procedure  for  basing  his  day-by-day  decisions  on  the  most  recent  data  base  as  it 
is  continuously  being  updated  during  system  development. 

• i 

B.  BACKGROUND 

During  the  past  three  years,  che  Directorate  of  Aerospace  Studies,  AFSC, 
(formerly  designated  the  Office  of  the  Assistant  for  Study  Support)  has  been 
engaged  in  a variety  of  studies  concerning  test  and  evaluation  and  the  develop- 
ment of  program  management  tools  relating  to  Design  to  Cost,  and  Life  Cycle  Cost. 

In  the  first  of  these  studies  the  test  and  evaluation  program  for  the  A-7D  was 
analyzed  (Reference  1).  In  the  A-7D  analysis,  the  impact  of  reliability  on 
logistic  support  costs  was  treated  very  briefly,  and  in  subsequent  work  these 
ideas  were  extended  leading  to  the  development  of  a generalized  methodology.  A 
description  of  the  methodology  is  presented  in  the  form  of  an  annotated  briefing 
in  Reference  2,  and  Reference  3 contains  a detailed  mathematical  development  to- 
gether with  some  illustrative  aircraft  oriented  examples.  However,  the  methodology 
is  not  restricted  to  aircraft;  it  is  general  enough  to  be  applied  to  nearly  any 
system.  Recent  efforts  have  been  devoted  to  applications  of  the  methodology  to 
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specific  programs.  Reference  4 contains  the  results  of  s in  application  to  a 
target  activated  munitions  program  (Grasshopper  Mine),  ana  portions  of  the  metho- 
dology have  been  applied  to  the  Jamming  Subsystem  of  the  EF-111A  and  are  de.jmented 
in  Reference  5. 

# 

In  the  belief  that  the  models  might  be  of  use  to  the  program  managers, 
program  engineers,  and  system  designers  of  a large  variety  of  systems,  this 
handbook  is  presenttd  to  explain  in  detail  how  to  apply  the  methodology  without 
burdening  the  user  with  the  detailed  mathematical  development  contained  in 
Reference  3.  It  should  be  emphasized,  however,  that  this  methodology  cannot 
replace  judgement  and  the  expertise  in  the  specialized  disciplines  associated 
with  a program  office.  Rather,  these  are  management  tools  which  can  be  used  by 
the  Program  Manager  to  integrate  the  inputs  of  the  various  disciplines  thereby 
maintaining  a continuing,  comprehensive  picture  ?,f  program  status. 


An  overview  of  the  methodology  is  presented  in  Section  II.  The  remaining 
sections  provide  detailed  guidance  for  implementing  the  models. 
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SECTION  II 
OVERVIEW 


A.  GENERAL 

A brief  description  of  the  models  is  presented  in  this  section  to  acquaint 
the  program  manager  with  the  general  methodology  and  indicate  the  potential  use 
as  a management  tool.  In  the  subsequent  sections,  detailed  instructions  showing 
how  to  implement  each  model  will  be  presented  together  with  discussions  of  model 
outputs,  and  appropriate  examples. 

B.  MISSION  COMPLETION  SUCCESS  PROBABILITY 

The  first  model  to  be  considered  is  the  Mission  Completion  Success  Probability 
(MCSP)  model.  The  MCSP  model  determines  the  probability  that  a system  completes 
its  mission  without  being  degraded  below  acceptable  limits  because  of  a critical 
failure  of  one  cr  more  of  its  subsystems.  Therefore,  assuming  thit  all  other 
technical  specifications  such  as  speed,  range  and  accuracy  have  been  met,  the 
MCSP  is  a measure  of  total  system  performance.  The  principal  use  of  MCSP  models 
is  to  provide  early  insight  into  the  operational  impact  of  system  reliability. 

MCSP  models  also  call  attention  to  reliability  problem  areas  early  in  the  program 
so  that  appropriate  action  can  be  taken. 

Figure  1 shows  the  Input-Output  Diagram  for  the  MCSP  Model.  The  inputs  re- 
quired for  implementing  the  MCSP  model  are  further  described  as  follows: 

• Mission  Profile  - The  mission  profile  is  a detailed  description  of  the 
operational  tasks  or  mission  the  system  is  expected  to  perform.  The  mission  is 
divided  into  phases  and  during  each  phase  certain  functions  must  be  performed  by 
various  subsystems.  For  example,  the  profile  for  a tactical  fighter  aircraft 
performing  an  interdiction  missior  might  consist  of  the  following  phases:  Start, 

ground  operation  and  takeoff,  penetration  to  target,  target  area,  return  to  base, 
landing  and  ground  operation. 
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Figure  1.  Input-Output  Diagram  of  the  Mission  Completion 
Success  Probability  Model. 
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• Mission  Essential  Subsystems  - A particular  mission  requires  that 
certain  operational  functions  be  performed  for  the  system  to  successfully 
complete  Its  mission,  e.g.,  comnunlcatlons,  navigation,  target  accuisitlon,  etc. 
Those  subsystems  required  to  perform  these  functions  are  defined  as  the  mission 
essential  subsystems.  Mission  essential  subsystems  can  be  considered  a generic 
term  for  dividing  the  total  system  into  functional  units.  Depending  on  the 
application,  these  functional  units  could  be  sjbsystems,  line  replaceable  units, 
or  a similar  breakdown  as  appropriate.  The  term  mission  essential  subsystems 
will  be  used  throughout  this  handbook  to  designate  the  subunits  of  the  total 
system. 

• Subsystem  Operating  Times  - In  conjunction  with  the  phases  defined  in 
the  mission  profile,  the  mission  essential  subsystem  operating  times  (duty 
cycles)  for  each  phase  are  determined,  or  in  the  event  a subsystem  performs  only 
a single  operation,  the  phase  in  which  that  operation  occurs  is  specified.  For 
example,  the  landing  gear  of  an  aircraft  would  be  required  during  ground  operation, 
takeoff  and  landing.  Thus,  the  landing  gear  duty  cycle  would  correspond  to  these 
phases  of  the  mission  profile. 

• Subsystem  Failure  Data  - If  the  mission  essential  subsystem  is  to  oper- 
ate over  a period  of  time,  the  failure  data  is  usually  in  the  form  of  mean  time 
between  failure  (MTBF).  For  single  event  subsystems,  the  failure  data  is  usually 
in  the  form  of  the  ratio  of  the  number  of  failures  to  the  number  of  trials  of  the 
event. 

• Failure  Criticality  Factors  - Although  all  failures  require  some  type 
of  maintenance  action,  all  failures  do  not  necessarily  degrade  the  system's  capa- 

bility to  perform  the  required  mission.  For  example,  a burned  out  bulb  is  nor- 
mally not  as  serious  as  a burned  out  transistor  in  a critical  circuit.  Thus,  a 
measure  of  the  seriousness  of  the  failure  is  required.  This  measure  is  provided 
by  the  failure  criticality  factor,  which  is  the  fraction  of  the  total  number  of 
failures  that  a mission  essential  subsystem  would  be  expected  to  experience  during 
the  mission  which  are  serious  enough  to  unacceptably  degrade  or  abort  the  mission. 
In  mathematical  terms,  the  failure  criticality  factor  is  the  conditional  proba- 
bility of  unacceptable  degradation  given  that  the  subsystem  experiences  a failure 
during  the  mission. 


With  the  above  Inputs,  the  MCSP  model  outputs  are: 

• System  MCSP  - The  probability  that  all  mission  essential  subsystems 
successfully  perform  their  functions  throughout  all  mission  phases.  This  Is 
the  primary  output  of  the  MCSP  model  and  provides  a measure  of  system  rel la- 
bility with  respect  to  the  defined  mission. 

• Probability  of  Successful  Subsystem  Operation  - The  probability  that  a 
particular  mission  essential  subsystem  successfully  performs  Its  function  can  be 
examined  for  a particular  mission  phase  or  for  cny  number  of  consecutive  phases. 

• Critical  Subsystem  Ranking  - The  model  ranks  the  mission  essential 
subsystem  in  terms  of  the  probability  of  experiencing  a critical  failure  during 
the  mission.  This  identifies  those  subsystems  with  the  greatest  likelihood  of 
degrading  the  system  below  acceptable  limits  during  the  mission. 

• Sensitivity  Analysis  - The  model  provides  a sensitivity  analysis  which 
shows  the  increase  in  system  MCSP  resulting  from  reliability  improvement  of  one 
or  more  mission  essential  subsystems. 

In  addition  to  illustrating  the  operational  Impact  of  system  and  subsystem 
reliability,  the  MCSP  methodology  may  be  useful  in  establishing  realistic  reli- 
ability goals.  For  instance,  the  sensitivity  analysis  shows  that  reliability 
improvement  of  the  subsystems  oeyond  certain  values  has  essentially  no  impact  on 
MCSP  enhancement.  On  the  other  hand,  if  the  MCSP  is  relatively  Insensitive  to 
any  reliability  improvement  of  a particular  subsystem  this  gives  an  Indication 
that  perhaps  a lower  cost,  less  reliable  subsystem  could  be  substituted,  with 
the  resulting  cost  savings  more  effectively  invested  in  improving  reliability 
of  other  subsystems.  The  MCSP  model  also  plays  a very  important  role  in  the 
Designing  to  System  Performance/Cost  model,  which  is  described  In  the  next 
section.  The  inputs  and  outputs  of  the  MCSP  model  are  described  in  greater 
detail  In  Section  III.  Also,  Section  III  contains  numerical  examples  to  aid  the 
reader  in  understanding  the  mettodo'ogy. 
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C.  DESIGNING  TO  SYSTEM  PERFORMANCE/COST 
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The  second  model  to  be  considered  Is  the  Designing  to  System  Performance/Cost 
(DSPC)  model.  This  model  provides  for  the  optimal  allocation  of  resources  and 
can  be  employed  during  preliminary  design  to  select  the  Initial  or  Baseline  System 
configuration  from  among  competing  subsystems.  However,  Its  main  application  Is 
during  the  development  process  if  additional  subsystem  options  become  available 
or  a reliability  improvement  program  Is  undertaken. 


Once  the  Baseline  System  has  been  established,  the  MCSP  model  can  be  applied 
to:  determine  if  the  reliability  requirements  are  adequate;  Identify  the  mission 
critical  subsystems;  and  to  perform  a sensitivity  analysis  which  shows  the  impact 
on  mission  success  due  to  reliability  improvements  of  individual  subsystems  or 
groups  of  rubsystems.  Often,  the  Baseline  System  MCSP  falls  btlow  a level  deemed 
necessary  to  meet  mission  requirements.  When  this  happens,  mission  requirements 
can  either  be  relaxed,  or  It  is  necessary  for  the  Program  Manager  to  initiate  a 
reliability  improvement  program.  A great  deal  of  time,  effort,  and  money  can  be 
wasted  if  such  a program  is  not  conducted  in  a systematic  manner,  e.g.,  the  re- 
liability of  some  subsystems  might  be  improved  more  than  necessary,  while  the  re- 
liability of  other  subsystems  might  not  be  improved  enough.  The  DSPC  methodology 
provides  a means  of  conducting  a reliability  improvement  program  In  a systematic 
manner.  This  is  accomplished  by  Investigating  reliability  improvement  options. 
These  options,  in  the  form  of  varying  levels  of  subsystem  reliability  and  the 
cost  associated  with  each  level,  wouid  involve  established  techniques  for 
improving  reliability  and  generally  could  range  all  the  way  from  replacing  low 
reliability  components  with  higher  reliability  components  to  complete  redesign  of 
the  subsystem.  (Even  if  the  Baseline  System  MCSP  appears  satisfactory,  the 
Program  Manager  should  consider  additional  subsystem  options  since  In  any  case 
the  developing  command,  using  coitmand,  and  supporting  command  are  all  vitally 
interested  in  the  most  reliable  system  that  the  available  funding  can  provide.) 

During  the  development  of  a system,  the  Program  Manager  is  continually  tasked 
to  evaluate  engineering  changes  or  modifications  which  improve  performance,  reduce 
costs,  or  both.  It  can  be  a formidable  task  to  determine  which  combination  of 
options  yields  the  maximum  MCSP  at  some  prescribed  level  of  cost.  The  DSPC 
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model  provides  a staple  algorithm  for  calculating  the  optimal  MCSP  versus  cost 
curve  and  identifies  the  combination  of  subsystem  options  associated  with  each 
vertex  point  on  the  curve.  To  demonstrate  the  necessity  for  such  an  efficient 
algorithm,  consider  an  aircraft  system  such  as  the  A-7D.  For  this  aircraft, 
a total  of  36  mission  essential  subsystems  were  identified.  If  for  example, 
during  the  development  phase,  2 reliability  improvement  options  had  been  avail- 
able for  each  subsystem,  then  the  total  number  of  possible  system  configurations 
(combinations  of  subsystem  options)  would  have  been: 

336  = 1.5  x 1017  . 

Clearly,  it  would  be  impossible  to  investigate  each  of  these  combinations.  Even 
if  considerable  initial  screening  could  be  accomplished  and  a very  efficient 
digital  computer  were  utilized  to  examine  the  combinations,  the  cost  and  time 
involved  would  be  prohibitive.  However,  even  in  this  extreme  example  and  without 
any  initial  screening,  the  DSPC  model  would  require  at  most  108  calculations 
in  order  to  generate  the  optimal  MCSP  versus  cost  curve.  Applying  the  DSPC 
methodology,  the  optimal  MCSP  versus  cost  curve  can  be  determined  quickly  using 
an  electronic  calculator.  A digital  computer  program  is  also  available  (Ref- 
erence 3). 

Figure  2 shows  a typical  output  of  the  DSPC  model.  In  this  hypothetical  ex- 
ample, the  MCSP  and  cost  of  the  Baseline  System  determine  the  starting  point  on 
the  DSPC  curve.  The  next  point  on  the  curve  represents  the  best  selection, 
among  the  available  subsystem  reliability  improvement  options,  for  a system 
configuration  at  the  corresponding  cost,  i.e.,  for  this  particular  cost  there  is 
no  combination  of  subsystem  options  yielding  a higher  MCSP.  Subsequent  points 
on  the  DSPC  curve  are  established  in  the  same  way  and  have  the  same  interpreta- 
tion. Thus,  to  each  vertex  point  on  the  curve,  there  correspond-  a uniquely 
defined  combination  of  subsystem  options,  i.e.,  system  configuration.  These 
vertex  points  show  the  maximum  performance  achievable  (by  selection  ot  the  optimal 
combination  of  subsystem  options)  at  the  associated  cost.  Furthermore,  all  other 
combinations  are  nonoptimal  and  hence  lie  below  the  DSPC  curve.  This  type  of  in- 
formation can  be  of  great  value  to  the  Program  Manager  as  well  as  higher  level 
Decision  Makers  since  it  provides  an  overall  picture  of  achievable  system 
performance  as  a function  of  cost.  Such  information  could  provide  the  basis  for 


14 


\ 


/ 


/ 


✓ 


[ 

! 

[ 


\ 


/ 

/ 


•.^'4  - 


J i* i 

< ' 


/ 


y.  • 


S' 

» 

V 


B 

y 
o 

B 
0 
c 
n 

G 

E 

. n 

E 

E 

v E 

. „ E 


r 

«u 

I 

I 

I 


zzzr^-.Trrc 


•■— :•  ■*”■■•  TTC 


adjusting  OTC  goals  or  mission  requirements.  For  example,  with  a fixed  program 
cost.  It  may  be  more  cost  effective  to  purchase  fewer  systems  (with  higher  MCSP) 
at  a unit  cost  greater  than  originally  planned.  This  was  shown  In  application 
of  the  methodology  to  the  Grasshopper  Mine  Program  (Reference  4). 


COST 


Figure  2.  Typical  Output  of  OSPC  Model 


This  type  of  analysis  could  also  indicate  where  cheaper  subsystems,  which 
do  not  appreciably  degrade  performance,  could  be  substituted  for  more  expensive 
subsystems.  The  resulting  savings  could  be  invested  In  improving  the  subsystems 
having  greater  impact  on  mission  success.  It  should  also  be  noted  that  a 
designer  of  a subsystem  can  apply  the  same  methodology  in  improving  the  subsystem 
reliability,  i.e.,  selecting  optimal  component  reliability  options.  In  this  case, 
the  subsystem  would  play  the  role  of  the  system  and  the  subsystem  components  would 
play  the  role  of  the  subsystems. 

In  Section  IV,  the  DSPC  model  is  explained  In  greater  detail , and  numerical  - 
examples  are  presented  to  facilitate  understanding. 
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D.  DESIGNING  TO  SYSTEM  PERFORMANCE/COST/EFFECTIVENESS 

The  MCSP  is  a measure  of  the  mission  reliability  of  the  total  system;  hence. 
It  also  plays  a part  in  evaluating  system  effectiveness,  e.g.,  an  aircraft 
must  reach  its  target,  a land  mine  must  be  operative,  etc.  The  DSPC  model 
selects  the  optimal  combination  of  subsystems  to  perform  this  aspect  of  th..- 
mission.  However,  the  ultimate  objective  of  the  mission  is  at  a higher  level, 
e.g.,  to  destroy  a target,  disable  a tank,  etc.  This  objective  Is  used  in  the 
establishment  of  some  measure  of  effectiveness  for  the  total  system.  Certain 
subsystems  more  directly  Influence  this  measure  of  effectiveness  than  others, 
e.g.,  subsystems  relating  to  weapons  delivery  accuracy,  mine  sensor  range, 
etc.  If  options  (in  the  form  of  varying  levels  of  effectiveness  and  the  cost 
associated  with  each  level)  are  available  for  these  subsystems,  then  the 
Designing  to  System  eerformance/Cost/Effectiveness  (DSPCE)  methodology  c?n  be 
employed  to  determine  that  combination  of  subsystem  options  yielding  the  maximum 
system  effectiveness  at  any  prescribed  cost.  Eacf  effectiveness  option  will 
also  be  characterized  by  a certain  level  of  reliability  as  well  as  effective- 
ness. For  example,  a highly  sophisticated  and  accurate  weapons  delivery  sub- 
system, with  low  reliability,  might  not  be  selected  in  an  optimum  system  con- 
figuration because  it  leads  to  less  mission  effectiveness  then  a competing 
subsystem  with  lower  accuracy  but  higher  reliability.  (If  there  are  no  effective- 
ness options  available  for  those  subsystems  directly  related  to  the  measure  of 
effectiveness,  then  only  the  DSPC  model  is  applicable,  i.e.,  the  mission 
effectiveness  associated  with  a particular  system  configuration  determined  to 
be  optimum  by  the  DSPC  model  will  be  the  maximum  effectiveness  achievable  at 
that  particular  cost). 

Figure  3 depicts  a typical  output  of  the  DSPCE  model  when  subsystem  effec- 
tiveness options  a-e  available.  The  discussion  is  similar  to  that  presented 
for  Figure  2 except  that  in  this  case  the  DSPCE  algorithm  optimizes  total 
system  effectiveness  (which  includes  MCSP)  with  respect  to  cost.  All  other 
system  configurations  lead  to  points  below  the  curve  in  Figure  3,  (i.e.,  are 
non-optimal). 
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Figure  3.  Typical  Output  of  DSPCE  Model. 

The  itility  of  the  DSPCE  algorithm  Is  best  Illustrated  by  the  results  of 
the  application  of  the  methodology  to  the  Grasshopper  Mine  Program  (Reference  4). 
In  this  program,  reliability  options  together  with  the  warhead  options  led  to 
1,536  possible  Grasshopper  configurations.  The  application  of  the  DSPCE 
methodology  showed  that  only  7 of  these  configurations  were  optimal.  The 
remaining  1,529  configurations  led  to  lower  effectiveness  at  their  respective 
levels  of  cost  and  consequently  were  eliminated  from  consideration. 

More  details  on  the  DSPCE  methodology  can  be  found  In  Section  V along  with  a 
numerical  example. 

E.  SYNOPSIS 

Figure  4 presents  a synopsis  of  the  methodology  in  the  form  of  an  overview  of 
the  application  of  the  DTC  management  tools  described  previously.  Starting  with 
the  Baseline  System  configuration,  which  in  some  cases  could  have  been  established 
using  DSPC  techniques,  the  MCSP  model  determines  the  Baseline  MCSP,  ranks  those 
subsystems  with  the  greatest  likelihood  of  causing  degraded  or  aborted  missions. 
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and  performs  subsystem  sensitivity  analyses.  This  indicates  to  the  Program 
Manager  those  subsystems  for  which  additional  options  should  be  sought.  When 
these  additional  options  become  available  the  DSPC  model  will  Identify  the 
combination  of  options  yielding  the  maximum  MCSP  (overall  systen  reliability) 
at  any  prescribed  level  of  cost.  The  DSPCE  model  analyzes  effectiveness  as  well 
as  reliability  to  identify  the  combination  of  subsystem  options  yielding  the 
maximum  mission  effectiveness  at  any  prescribed  cost.  If  the  system  MCSP  or 
effectiveness  is  marginal,  or  If  the  cost  is  too  high,  the  program  should  be  re- 
evaluated, and  if  possible,  additional  options  should  be  obtained  and  the  process 
repeated.  This  process  can  be  applied  early  in  the  program  using  engineering 
estimates  for  input  data.  As  the  pregram  continues,  the  data  base  is  improved 
by  incorporating  test  data.  Thus,  the  Program  Manager  can  make  the  best  selection 
of  subsystem  options  with  respect  to  a constantly  improving  data  base.  The 
management  tools  described  above  are  available,  have  been  validated,  and  should 
be  of  interest  to  Program  Managers  and  DOD  Decision  Makers  In  a wide  variety  of 
fields. 

The  discussions  in  this  section  have  presented  a brief  description  of  the 
types  of  decision-making  information  that  can  be  generated  by  the  various  method- 
ologies that  have  been  developed  by  the  Directorate  of  Aerospace  Studies.  In 
the  subsequent  sections,  step-by-step  procedures  for  implementing  the  methodologies 
are  presented. 
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Figure  4.  Synopsis  of  Methodology. 
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This  and  the  remaining  sections  describe  the  procedures  for  Implementing  the 
models  described  in  Section  II.  The  methodology  and  Instructions  are  written 
In  general  terms.  However,  each  systen  has  Its  own  unique  characteristics  and 
the  °rogram  Manager,  familiar  with  his  own  system,  can  easily  adapt  the  general 
methodology  to  a comprehensive  description  of  the  performance  of  his  specific 
system. 

6 

The  Input-Output  Diagram  for  the  MCSP  model  was  presented  In  Figure  1 on 
pagelO.  The  MCSP  is  a measure  of  the  ability  of  a system  to  perform  a proposed 
operational  task  for  which  it  Is  being  designed  without  being  degraded  below 
an  acceptable  level  by  a critical  failure  of  any  of  Its  subsystems.  In  other 
words,  it  is  a measure  of  the  reliability  of  the  total  system  in  performing 
its  proposed  operational  task.  In  this  section  each  required  Input  will  be 
defined  and  discussed,  and  detailed  Instructions  for  calculating  the  outputs 
will  be  presented  along  with  appropriate  examples. 

B.  MCSP  MODEL  INPUTS 

• i “*?  n « 

# i . 

1.  Mission  Profile.  The  mission  profile  Is  a detailed  description  of  a 
proposed  operational  task  or  mission  the  system  is  expected  to  perform.  The 
Program  Manager  can  translate  the  original  system  requirement  into  a mission 
profile  which  can  be  modified  as  the  development  cycle  matures  to  best  reflect 
the  operational  modes  planned  for  the  system.  This  places  emphasis  upon  the 
importance  of  Involvement  of  the  user  early  in  the  development  cycle  and  fur- 
nishes a rationale  for  the  Program  Manager  to  advocate  constant  communication 
across  major  command  lines  with  the  user.  The  mission  Is  divided  into  phases, 
and  during  each  phase  certain  functions  must  be  performed  If  the  system  Is  to 
meet  Its  operational  requirements.  If  the  system  is  required  to  perform  several 
types  of  missions,  then  a mission  profile  can  be  defined  for  each  mission.  The 
MCSP  model  can  then  be  applied  to  each  of  these  individual  missions.  A mission 
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profile  for  target  activated  munitions  Is  presented  In  F.1gure  5,  page  32  and 
a mission  profile  for  tactical  Interdiction  Is  presented  In  Figure  7,  page  37. 

2.  Mission  Essential  Subsystems.  A particular  mission  profile  Identifies 
the  operational  functions  which  must  be  performed  for  the  system  to  successfully 
complete  Its  mission.  The  subsystems  required  to  perform  those  functions  are 
defined  as  the  mission  essential  subsystems.  These  mission  essential  subsystems 
are  classified  into  three  types: 

• Time  Operating  Independent  Subsystems.  These  subsystems  are 
required  to  operate  over  a period  of  time  during  various  mission  phases.  In 
addition,  each  subsystem  of  this  type  has  the  property  that  a critical  failure 
of  that  subsystem  would  degrade  the  mission  below  an  ?cceptable  level  (since 
each  such  subsystem  must  operate  without  a critical  failure  these  subsystems 
are  Independent  in  the  probabilistic  sense). 

• Single  Event  Independent  Subsystems.  These  subsystems  are  required 
to  perform  a single  operation  (or  several  operations)  at  a particular  time  (or 
times)  during  the  mission.  Their  operating  time  is  essentially  zero,  and  they 
have  the  property  that  a critical  failure  of  any  such  subsystem  would  degrade  the 
mission  below  an  acceptable  level. 

• Pseudo-Subsystems . The  MCSP  is  the  probability  that  each  mission 
essential  function  is  successfully  performed.  However,  tr.ere  may  be  cases 
when  two  or  more  subsystems  are  not  independent  but  interact  in  the  performance 
of  a given  function.  It  is  necessary  to  define  the  interrelationship  between 
such  subsystems  and  treat  them  as  a single  "subsystem"  referred  to  as  a "pseudo- 
subsystem".  A pseudo-subsystem  consists  of  a set  of  time  operating  or  single 
event  subsystems,  referred  to  as  the  "elements"  of  the  pseudo-subsystem.  The 
probability  that  a pseudo-subsystem  completes  Its  required  function  can  be  cal- 
culated according  to  the  defined  interdependency  and  characteristics  of  its 
elements.  Furthermore,  if  any  elements  are  improved  the  Increased  performance 
of  the  pseudo-subsystem  can  be  determined.  A pseudo-subsystem  will  be  consi- 
dered as  a single  "subsystem"  in  the  MCSP  and  DSPC  models. 


The  success  probability  of  a pseudo-subsystem  In  completing  Its  required 
function  Is  characterized  by  the  property  that  It  Is  never  equal  to  the  r uu; 
of  the  success  probabilities  of  Its  elements.  Otherwise  the  elements  wouiu  be 
Independent  subsystems  of  the  first  two  types.  Therefore,  the  success  probabil- 
ity of  the  pseudo-subsyst1*)  Is  always  greater  than  the  -oduct  of  the  cess 
probabilities  of  Its  elements  (since  the  product  Implle.  . ir.t  each  el&..*..it  must 
operate  without  a critical  fai  . 

As  a simple  example,  suppose  a mission  function  requires  that  for  two 
specified  subsystems  at  least  one  must  operate  successfully  (i.e.,  without  « 
critical  failure).  Let  denote  the  success  probability  of  one  subsystem  and 
P2  denote  the  success  probability  of  the  other  subsystem.  The  probability 
that  the  mission  function  is  successfully  performed  is  equal  to  the  probability 
that  at  least  one  of  the  subsystems  operates  successfully,  i.e.,  1 - (1-Pj )(1-P2). 
Thus,  these  two  subsystems  are  not  probabilistlcly "independent "and  hence 
constitute  a pseudo-subsystem  consisting  of  two  elements.  If  the  mission 
function  required  both  subsystems  to  operate  successfully  then  the  success 
probability  of  that  function  would  be  the  product  PjPg.  The  subsystems,  in  this 
case,  would  not  constitute  a pseudo-subsystem;  they  would  be  independent  sub- 
systems of  the  above  types.  „ 

3.  Subsystem  Operating  Times.  In  conjunction  with  the  phases  defined  in 
the  mission  profile,  the  mission  essential  subsystem  operating  times  (duty 
cycles)  for  each  phase  are  determined,  or  the  phase  during  which  a single  event 
subsystem  performs  Its  function  is  specified.  This  Information  is  also  required 
for  the  elements  of  a pseudo-subsystem. 

I 7 

4.  Subsystem  Failure  Data.  For  each  mission  essential  subsystem,  failure 

data  is  required  in  one  of  the  following  forms:  If  the  subsystem  is  to  operate 

over  a period  of  time,  the  failure  data  is  usually  In  the  form  of  mean  time  be- 
tween failure  (KTBF).  For  single  event  subsystems,  the  failure  data  Is  In  the 
form  of  the  ratio  of  the  number  of  critical  failures  to  the  number  of  trials  of 
the  event.  For  pseudo-subsystems  the  appropriate  failure  data  Is  required  for 
each  element  of  the  pseudo-subsystem.  During  the  conceptual  phase,  failure  data 
is  usually  obtained  by  such  means  as  estimates  based  on  historical  data  of  similar 


t 
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subsystems  (e.g.,  AFM  66-1  and  Reference  7)  or  detailed  engineering  analyses 
of  subsystem  components.  Other  sources  of  failure  data  are  Identified  in 
Reference  8.  However,  as  test  results  become  available  the  accuracy  of  the 
subsystem  failure  data  is  continuously  being  improved,  and  the  methodologies 
presented  in  this  handbook  provide  a means  for  the  Program  Manager  to  continuous- 
ly update  the  evaluation  of  system  progress  on  a daily  basis  as  improved  data 
becomes  available. 


5*  Subsystem  Failure  Criticality  Factors.  For  an  essential  subsystem 
operating  over  a period  of  time,  a failure  during  the  mission  does  not  necessarily 
mean  that  the  mission  would  be  dearaded.  It  depends  upon  the  type  of  failure  and 
also  upon  the  mission  phase  during  which  the  failure  occurs.  A failure  usually 
requires  some  maintenance  action,  but  many  failure  modes  have  no  effect  upon 
mission  success,  e.g.,  a loose  screw  or  some  other  minor  failure.  The  failure 
criticality  factor  of  a time  operating  independent  subsystem  during  a particular 
mission  phase  is  the  fraction  of  total  failures  occurring  during  that  phase 
which  lead  to  unacceptable  mission  degradation.  More  precisely,  it  is  the 
conditional  probability  of  unacceptable  mission  degradation  given  that  the  sub- 
system has  a failure  during  that  phase.  For  a time  operating  element  of  a 
pseudo-subsystem  the  failure  criticality  factor  is  the  fraction  of  failures 
which  lead  to  unacceptable  degradation  of  that  element.  The  reason  that  the 
criticality  factors  are  phase  dependent  can  be  made  clear  by  means  of  an  example: 

A failure  of  the  weapon  delivery  computer  of  an  attack  aircraft  is  much  more 
likely  to  degrade  (or  even  abort)  the  mission  if  the  failure  occurs  before 
weapon  release  than  if  the  failure  occurs  after  departing  the  target  area  when 
the  mission  is  essentially  accomplished.  An  example  of  failure  criticality 
factors  for  subsystems  of  an  aircraft  on  a tactical  interdiction  mission  are 
presented  in  Table  3 on  page  38. 

Failure  criticality  data  can  be  obtained  from  failure  mode  effects  analysis, 
historical  data,  and  data  collected  during  testing  in  conjunction  with  the  MTBF  «■ 
data.  As  the  accuracy  of  this  data  is  continuously  being  improved  throughout 
the  program,  the  models  presented  in  this  handbook  allow  the  Program  Manager  to 
continuously  improve  the  accuracy  of  the  evaluation  of  the  system. 
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For  single  event  subsystems  only  critical  failures  are  considered.  Therefore 
failure  criticality  factors  are  not  required  fsr  these  subsystems. 

C.  MCSP  MODEL  DEVELOPMENT 

1.  Mathematical  Basis.  In  evaluating  the  reliability  of  a subsystem,  the 
primary  Interest  Is  In  the  probability  that  the  subsystem  operates  for  a certain 
period  of  time  without  a failure,  or  In  the  ratio  of  number  of  successes  to 
total  number  of  trials  for  a single  event  subsystem.  Mission  requirements  and 
the  mission  profile  determine  the  operating  times  or  event  times  within  the 
mission  phases.  For  a subsystem  operating  for  time  t during  some  mission  phase, 
the  most  commonly  used  expression  for  calculating  the  probability  that  the  sub- 
system operates  for  time  t (duty  cycle  for  that  phase)  without  a failure  of  any 
’kind  is 


exp  j - 7 j . (III-l) 

where  t is  the  MTBF  of  the  subsystem.  The  assumption  of  the  exponential  re- 
liability function  (III-l)  Is  usually  justified,  but  if  a subsystem  is  known  to 
have  a different  reliability  function,  of  course  it  should  be  used  in  place  of 
Expression  (III-l).  The  exponential  reliability  function  is  justified  when  the 
cailure  rate  is  constant  over  the  time  period  of  interest.  It  can  be  used  for 
the  initial  approximation,  and  subsequently  changes  can  be  made  as  better  data 
become  available. 

Expression  (III-l)  is  the  probability  that  the  subsystem  operates  for  time  t 
without  a failure  of  any  kind.  As  discussed  above  under  Subsystem  Failure  Criti- 
cality Factors,  not  all  failures  are  serious  enough  to  degrade  or  abort  the 
mission.  Therefore,  Expression  (III-l)  must  be  modified  to  yield  the  probability 
that  the  subsystem  completes  its  operation  for  time  t without  experiencing  a 
critical  failure.  Let 


Fc  (HI-2) 

denote  the  failure  criticality  factor  of  the  subsystem  (or  element  of  a pseudo- 
subsystem) during  the  phase  considered  in  Expression  (III-l).  Since  x Is  the 


r 


subsystem  MTBF,  the  mean  time  between  critical  failure,  t , (Reference  3)  Is 
given  by 


Equation  (III-3)  shows  the  purpose  of  the  failure  criticality  factor.  It  is 

used  to  transform  the  MTBF  to  the  mean  time  between  critical  failure,  t . This 

c 

is  necessary  for  determining  the  MCSP  which  is  the  probability  that  the  system 
completes  its  mission  without  unacceptable  degradation  due  to  a critical  failure 
of  one  or  more  subsystems.  Therefore,  the  probability  that  the  subsystem  operates 
for  time  t (during  the  mission  phase  under  consideration)  without  a critical 
failure  is 


As  mentioned  previously,  for  the  single  event  subsystems,  the  failure  data 
is  based  upon  the  number  of  critical  failures  during  a certain  r umber  of  trials 
of  the  event.  Thus,  for  these  subsystems,  the  empirical  probability  of  success 
is  given  by 


where  n$  is  the  number  of  successes  (non-critical  failures)  observed  ar.d  N is 
the  number  of  trials. 

The  system  MCSP  is  determined  by  considering  all  mission  essential  subsystems 
throughout  all  mission  phases.  The  MCSP  model  will  be  developed  in  the  following 
section. 

2.  Mathematical  Formulation  of  the  MCSP  Model.  Early  in  a system  program 
the  subsystems  are  identified;  this  defines  the  Baseline  System.  When  the  inputs 
discussed  above  become  available  for  the  mission  essential  subsystems,  the  MCSP 
of  the  Baseline  System  can  be  calculated.  Before  proceeding  with  the  development 


(III-3) 


tF 


c 


exp 


T 


(III-4) 


( I I I -5) 
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of  the  MCSP  model,  the  following  mathematical  notation  Is  Introduced  which  also 
facilitates  the  development  of  the  OSPC  model.  The  mathematical  notation  and 
equations  may  at  first  appear  complex;  however,  the  simplicity  of  the  procedure 
will  ^come  apparent  by  means  of  examples  presented  at  the  end  of  this  section. 

N$  = Total  number  of  mission  essential  subsystems  (a  pseudo- 

subsystem Is  considered  as  one  subsystem). 

Np  5 Number  of  mission  phases  to  be  considered  In  calculating 

the  MCSP,  1.6,,  the  MCSP  through  phase  Np.  It  is  some- 
times of  interest  to  make  MCSP  calculations  for  values  of 
Np  less  than  the  total  number  of  mission  phases  defined 
in  the  mission  profile.  In  this  way,  the  system  MCSP  can 
be  analyzed  through  any  phase. 


t,(j) 


x(°) 


s Operating  time  (hours)  of  subsystem  i during  mission 
phase  j.  For  a single  event  subsystem,  operating  times 
are  not  required  (can  be  considered  0),  but  the  phase 
when  the  event  is  to  occur  must  be  specified. 

= Mean  time  (hours) between  failure  (MTBF)  of  subsystem  1. 
This  is  required  for  time  operating  independent  sub- 
systems. The  superscript  o is  used  to  indicate  that  the 
value  refers  to  the  baseline  subsystem;  if  subsystem 
options  become  available  the  superscript  will  assume 
other  values. 


Fci  = Failure  criticality  factor  of  subsystem  i during  phase 

j (j  - 1,  2,  ...»  Np).  It  is  the  conditional  probability 
of  unacceptable  mission  degradation  given  that  the  sub- 
system experiences  a failure  during  phase  j (refer  to 
discussion  on  page  25).  These  values  are  required  only 
for  subsystems  for  which  a value  of  has  been 
assigned. 
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pJ°  (j)  5 Conditional  probability  that  subsystem  1 completes  Its 
required  function  during  phase  j without  a critical 
failure  given  that  no  mission  essential  subsystem  has 
experienced  a critical  failure  prior  to  phase  j. 


= Probability  that  subsystem  1 completes  Its  required  functions 
through  phase  Np  without  a critical  failure  (given  that  no 
other  mission  essential  subsystem  has  experienced  a critical 
failure) . 


Pco  = The  Baseline  System  MCSP.  This  is  the  probability  that 

all  N$  essential  subsystems  complete  their  required  function 
(through  phase  Np)  without  experiencing  a critical  failure. 

To  calculate  the  MCSP  it  is  necessary  to  calculate  (for  each  subsystem  and 
each  mission  phase)  the  probability  that  the  subsystem  performs  its  function  with- 
out a critical  failure.  These  quantities  pH(j)  are  calculated  as  follows: 


a.  If  subsystem  i is  a time  operating  independent  subsystem  (applying 
the  exponential  reliability  distribution  discussed  on  pages25and  26), 


p!0)(J)  - exp 


Vj)  F <®>(J) 


Ti 


Tor 


(III -6a ) 


b.  If  subsystem  i is  a single  event  independent  subsystem  performing  a 
function  during  phase  j (refer  to  discussion  on  pages  23  and  26), 


,(o) 


(j) 


nsi(J) 

Mj) 


(III -6b) 


which  is  the  ratio  of  the  number  of  successes  to  the  number  of  trials  of  the 
event  during  phase  j (if  the  single  event  subsystem  does  not  perform  a function 
during  phase  j then  P-°^(j)  is  equal  to  1).  This  ratio  can  be  obtained  from 
estimates  based  on  historical  data,  engineering  estimates,  test  results  or  other 
means. 
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v.  *.  >uD5r5COT  , ,s  a pseudo-subsystem  the  value  of  p(°>m  „ 

calculated  according  to  the  defined  interdependency  of  its  el«J*  r 
the  operating  time  and  the  mean  ti- » between  critical  fail  S*  " addit1on’ 

for  each  time  operating  element  of  the  TV"* 

el^the  ratio  of  the  number  of  successes  to  the  n^ber  of  triaU^!^ 

z "nr/-  ~ -• 

rr.r.vr;” 


Pi 


(o) 


TTp{0,(j)  (1  - 1.  2.  ....  Ns)  . 

j - 1 a 


and  the  Baseline  System  MCSP  (all  subsystems  successfully  complete 
is  given  by 


(HI -7) 

their  functions) 


co 


TT ' 

i = 1 


,(o) 


(II I -8) 


The  abo,e  expressions  are  the  fundamental  equations  for  MCSP  model  inn- 

“r  le™T  Whe"  tMt  r““,ls  *—  •»'»«•  -flrtal  probabilities  oi  sub- 
system  mission  success  can  be  used  dire. cl-  in  Equation  (III-7)  for  the  calcula- 
tion  of  the  Baseline  System  MCSP. 

In  Section  III-E  some  detailed  numerical  examples  will  be  presented  to 
Illustrate  the  simplicity  in  applying  the  above  described  mathematical  procedure. 

0.  MCSP  MODEL  OUTPUTS 

->eline  S),st”  "“P.  The  Pf'wny  output  of  the  MCSP  model  is  the  Base- 
• ne  System  MCSP  as  determined  by  Equation  (II1-8).  This  value  provides  a measure 
Ota  system  reliability  and  provides  the  potential  user  with  early  insight 
into  the  operational  suitability  of  the  syste,  from  the  reliability  standpoint. 


2.  Critical  Subsystem  Ranking.  The  quantitative  ranking  of  the  most  criti- 
cal subsystems  Is  obtained  by  ordering  the  values  of  1 - pj0',  l.e.,  the  condition- 
al probability  that  subsystem  i experiences  a critical  failure  during  the  mission 
given  that  no  other  subsystem  has  failed.  This  identifies  those  subsystems  with 
the  greatest  likelihood  of  degrading  the  system  below  acceptable  limits. 

% 

3.  Sensitivity  Analysis  of  Subsystem  Improvement.  A sensitivity  analysis 
can  be  performed  to  show  MCSP  enhancement  as  a function  of  the  improvement  of 
one  or  more  subsystems.  If,  for  example,  the  performance  of  subsystem  i is 
improved  from  p|0^  to  p|^,  then  from  (III -8)  It  follows  that  the  Baseline  MCSP 
is  Increased  to 

/pn>\ 

Pc°l  pp  J • (III'4 * * * * 9) 

since  the  factor  in  parenthesis  removes  p|0^  and  replaces  it  by  pP^  in  equation 
(II 1-8) . In  many  cases,  it  is  of  interest  to  show  MCSP  improvement  as  a function 
of  increased  MTBF  of  a subsystem.  Equations  (III -6a)  and  ( I I 1-7)  together  with 
the  procedure  described  by  Expression  ( 1 1 1 -9)  can  be  used  to  show  the  impact  on 
system  MCSP  due  to  improving  the  MTBF  of  a subsystem.  The  MCSP  eventually  becomes 
essentially  insensitive  to  further  improvements  in  subsystem  MTBF.  This  is 
helpful  in  establishing  realistic  subsystem  MTBF  goals,  which  in  turn  can  be 
used  to  establish  realistic  system  MTBF  goals. 

4.  Probability  of  Successful  Subsystem  Operation.  The  subsystem  mission 

success  probability  can  be  examined  either  for  a particular  mission  phase  as 
given  by  p|°^(j)  or  for  any  number  of  consecutive  phases  by  changing  Np  in 
Equation  ( I I I -7 ) . This  is  sometimes  of  interest  since  it  shows  quantitatively 

the  individual  phases  or  the  cumulative  phases  during  which  ;he  greatest  number 
of  failures  occur. 

$ 

For  a pseudo-subsystem,  an  improvenent  of  any  of  its  elements  leads  to  an 

increase  in  its  original  value  of  p|0^;  this  new  value  is  calculated  as  described 
previously.  The  impact  on  the  system  MCSP  due  to  reliability  improvements  of  any 
elements  of  a pseudo-subsystem  can  then  be  determined  from  Expression  (III -9) . 
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5.  Probability  of  No  Subsystem  Failure.  Another  Important  measure  attached 
to  a system  Is  the  probability  that  the  system  completes  its  mission  without  a 
failure  (of  any  type)  of  any  essential  subsystem  or  any  element  of  a pseudo-sub- 
system.  This  measure  is  important  for  maintenance,  logistic  support  cost,  life 
cycle  cost  and  availability  considerations.  This  probability  Is  easily  obtained 
by  the  same  procedure  described  for  calculating  the  MCSP  with  the  following 
simpl ifications: 

a.  For  any  pseudo-subsystem,  consider  its  elements  as  independent 
subsystems  of  the  first  two  types  discussed  on  page  22;  and  change  N$  according- 
ly to  account  for  these  additional  subsystems. 

b.  Set  all  failure  criticality  factors  equal  to  1 (this  eliminates  the 
problem  of  determining  failure  criticality  factors). 

c.  Apply  equations  (III -6a ) , (III-6b),  ( 1 1 1 -7 ) and  ( 1 1 1 -8 ) . 

E.  MCSP  EXAMPLES 

1.  Target  Activated  Munitions.  A hypothetical  mine  system  Is  analyzed  in 
this  example  to  illustrate  the  approach  to  be  followed  in  applying  the  MCSP 
methodology.  A more  complete  analysis  of  an  actual  target  activated  munitions 
system  (Grasshopper  Mine)  can  be  found  in  Reference  4. 

The  mission  profile  of  the  mine  is  shown  pictorially  in  Figure  5. 

Table  1 identifies  the  mission  essential  subsystems  together  with  their  perfor- 
mance characteristics  during  each  phase.  The  Cutter,  Fin,  Brake,  Body,  and  War- 
head are  examples  of  single  event  subsystems,  whereas  some  of  the  electronic 
subsystems  must  operate  over  a period  of  time  (i.e.,  duty  cycle  of  240  hours). 

The  p|°^(j)  values  (estimates  or  test  results)  for  the  single  event 
subsystems  are  listed  in  Table  1.  The  probability  that  the  other  subsystems 
successfully  complete  their  required  functions  were  calculated  using  Equation 
(III-4).  For  example,  using  the  values  from  Table  1,  the  probability  that 
Sensor  B performs  its  function  without  an  abort  causing  failure  Is  given  by 

exp{-  -Soo'cT51}8  exp{-  -04}  " *96  (HI-10) 

which  aDpears  in  Table  2. 
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Table  1 

CHARACTERISTICS  OF  MINE  BASELINE  SYSTEM 


PHASE  1 

PHASE  2 

PHASE  3 

PHASL  4 

PHASE  5 

MISSION 

ESSENTIAL 

SU6SYSTLKS 

KlNC/DlSrtUSCR 

SEPARATION 

SUCCESS 

TARGET 

IDENTIFICATION 

CONDITIONAL 

DETONATION 

SUCCESS 

OL SCENT 
SUCCESS 

IMP!  ANT 
SUCCESS 

KTUF 

(»!rs) 

rc 

OPE RATI HO 
TIME 
(Mrs) 

WARHEAD 

— 

— 

— 

— 

— 

— 

.98 

STRUCTURE 

Cutter 

.60 

— 

— 

— 

— 

— 

— 

Fin 

— 

.70 

— 

— 

— 

— 

— 

Brake 

... 

— 

.75 

— 

— 

— 

... 

Body 

.98 

1.00 

.90 

— 

... 

— 

— 

FUZE  ASSEMBLY 

Sensor  A 

--- 

— 

... 

5,000 

.5 

240 

... 

Sensor  B 

... 

— 

— 

3,000 

.5 

240 

— 

PROCESSOR 

... 

— 

— 

2.000 

1.0 

240 

— 

UA1TLRY 

— 

— 

... 

2,500 

1.0 

240 

— 

SAFE  h AR?4 

— 

.95 

.95 

... 

— 

— 

— 

sTktcnnE  i 
HAPUSS 

— 

— 

35,000 

1.0 

240 

— 

In  Table  2 the  MCSP  Is  presented  together  with  a ranking  of  the  sub- 
systems in  terms  of  their  likelihood  of  experiencing  a critical  failure  during 
the  mission.  Taking  the  product  of  the  probabilities  ’isted  in  the  table  yields 
an  MCSP  of  .25.  In  the  case  of  a mine,  the  interpretation  of  MCSP  is  the  pro- 
bability that  the  mine  is  still  in  operative  condition  up  to  a specified  length 
of  time  (which  in  this  example  Is  240  hours)  given  that  it  was  not  activated  by 
a target. 
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Table  2 

MCSP  AND  CRITICAL  SUBSYSTEM  RANKING  OF  MINE  BASELINE  SYSTEM 


PROBABILITY  OF 

SUBSYSTEM 

SUCCESSFULLY 

RANKING  OF 

PERFORMING  ITS 

CRITICAL 

FUNCTION 

SUBSYSTEMS 

( pS°>  ) 

• 

FIN 

.70 

1 

BRAKE 

.75 

2 

CUTTER 

o 

CO 

• 

3 

BODY 

.88 

4 

SAFE  & ARM 

.90 

5 

BATTERY 

.91 

6 

PROCESSOR 

.91 

7 

SENSOR  B 

.96 

8 

SENSOR  A 

.98 

9 

WARHEAD 

.98 

10 

STRUCTURE  & HARNESS 

.99 

11 

11  ,ns 

MCSP  = "p[Pi  “ 
i=l 

.25 

Figure  6 is  presented  to  show  a sensitivity  analysis  of  the  Fin  which 
is  the  most  critical  subsystem.  It  shows  the  MCSP  enhancement  resulting  from 
improvement  of  the  Fin  holding  all  other  subsystem  probabilities  constant.  The 
improvement  of  only  the  Fin  can  increase  the  MCSP  from  its  Baseline  value  of 
.25  to  a maximum  of  .36.  Any  further  MCSP  enhancement  would  require  Improve- 
ments of  additional  subsystems.  A similar  sensitivity  analysis  can  be  performed 
for  any  other  subsystem  or  combination  of  subsystems. 
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The  Interdiction  Mission  Profile  Is  shown  in  Figure  7.  From  the  phase 
times  and  the  phase  descriptions,  the  subsystem  functions  required  during  each 
phase,  qualitative  failure  criticality  considerations  for  each  phase,  and  sub- 
system operating  times  are  determined.  For  example,  all  subsystems  are  assumed 
to  be  operating  during  the  ground  checkout  during  Phase  1 and  certain  failures 
detected  at  this  time  could  abort  the  mission  even  though  the  actual  subsystem 
function  is  not  required  until  a later  phase. 


Table  3 lists  the  mission  essential  subsystems  and  the  associated  relia- 
bility data.  This  data  was  extracted  from  the  AFM  66-1  maintenance  data  system 
as  reported  in  the  Maintainability  Reliability  Summary  (DD  56  B5527).  Of  all 
the  AFM  66-1  reports  (DD  56),  the  Maintainability  Reliability  Summary  is  the 
best  source  of  failure  data  for  MCSP  calculations  for  Air  Force  aircraft  weapon 
systems.  This  summary  provides  the  failure  rate  (reciprocal  of  MTBF)  for  each 
subsystem,  the  abort  rate,  and  a description  of  the  failures  from  which  the 
failure  criticality  factor  can  be  derived.  Some  subsystems  such  as  the  Airframe, 
Escape  Capsule,  Air  Conditioning,  etc.,  impact  the  MCSP  only  if  the  subsystem 
failure  causes  an  abort.  Therefore,  for  these  subsystems,  the  failure  criticality 
factor  is  derived  from  the  abort  rate.  Other  subsystems,  such  as  the  Flight 
Controls,  Propulsion,  Electrical  Power,  etc.,  could  experience  failures  which 
do  not  necessarily  abort  the  mission  but  seriously  degrade  system  capability. 

For  these  subsystems,  the  failure  criticality  factor  Is  derived  from  the  failure 
description  data  for  mission  phases  up  through  the  target  phase  and  from  the 
abort  rate  for  mission  phases  after  the  target  phase.  Table  3 illustrates  the 
phase  dependency  of  the  criticality  factors,  e.g.,  the  ECM  subsystem  Is  most 
critical  penetrating  hostile  territory  while  the  Fire  Control  and  Weapons 
Delivery  subsystems  are  most  critical  over  the  target  area. 


In  Table  4,  the  subsystem  operating  times  or  duty  cycles  are  presented. 
In  this  example,  for  ease  of  calculation,  if  subsystems  are  operated  at  all 
during  a particular  phase,  they  are  assumed  to  operate  for  the  entire  phase. 
This  is  not  generally  the  case  in  actual  operations;  for  example,  even  though  a 
subsystem  operates  during  the  ground  check,  it  does  not  necessarily  operate 
throughout  Phase  1 which  also  Includes  taxi,  takeoff,  and  climbout.  Duty  cycle 
variations  are  easily  adjusted  in  Equation  (III -6a ) when  subsystem  operating 
times  are  not  equal  to  mission  phase  times. 


Using  the  data  presented  in  Tables  3 and  4,  MCSP  calculations  can  be  made 
as  follows: 
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1 - Engine  turnup,  systems  checkout,  taxi, 

takeoff,  cllmbout 

2 - Letdown,  penetration,  radar  navigation 

3 - Low  level  navigation  enroute  to  target 

4 - Target  acquisition,  bomb  releases 

.k  . 

5 - Depart  target,  low  level  navigation 

through  egress 

6 - Depart  hostile  territory,  climbout, 

navigation  enroute  to  base 

7 - Approach,  landing,  engine  shutdown 
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Table  3 

TYPICAL  FIGHTER-BOMBER  RELIABILITY  DATA 
SOURCE:  AFM  66-1 


MISSION 

MTBF 

(Mrs) 

FAILURE  CRITICALITY  FACTORS 

ESSENTIAL 

SUBSYSTEMS 

MISSION  PHASES 

1 

2 

3 

4 

5 

6 

7 

AIRFRAME 

14 

.003 

.003 

.003 

.003 

.003 

.003 

.003 

LANDING  GEAR 

13 

.382 

.013 

.013 

.013 

.013 

.013 

.382 

FLIGHT  CONTROLS 

10 

.370 

.370 

.370 

.370 

.370 

.026 

.026 

ESCAPE  CAPSULE 

29 

.006 

.006 

.006 

.006 

.006 

.006 

.006 

PROPULSION 

32 

.492 

.492 

.492 

.492 

.492 

.032 

.032 

AIR  CONDITIONING 

22 

.014 

.014 

.014 

.014 

.014 

.014 

.014 

ELECTRICAL  POWER 

48 

.552 

.552 

.552 

.552 

.552 

.035 

.035 

LIGHTING 

20 

.002 

.002 

.002 

.002 

.002 

.002 

.002 

HYDRAULIC/PNEUMATIC 

18 

.818 

.818 

.818 

.818 

.818 

.021 

.021 

FUEL 

21 

.025 

.025 

.025 

.025 

.025 

.025 

.025 

OXYGEN 

63 

.006 

.006 

.006 

.006 

.006 

.006 

.006 

MiSC  UTILITIES 

70 

.011 

.011 

.011 

.011 

.011 

.011 

.011 

INSTRUMENTS 

19 

.014 

.014 

.014 

.014 

.014 

.014 

.014 

AUTO  PILOT 

14 

.054 

.054 

.054 

.054 

.054 

.054 

.054 

HF  COMMUNICATIONS 

68 

.680 

.680 

.680 

.680 

.680 

.004 

.004 

UHF  COMMUNICATIONS 

43 

.398 

.398 

.398 

.398 

.398 

.016 

.016 

INTERPHONE 

81 

.491 

.491 

.491 

.491 

.491 

.010 

.010 

IFF 

80 

.630 

.630 

.630 

.630 

.630 

.012 

.012 

RADIO  NAVIGATION 

42 

.001 

.001 

.001 

.001 

.001 

.001 

.001 

BOMB/NAVIGATION 

6 

.750 

.750 

.750 

.750 

.500 

.019 

.019 

FIRE  CONTROL 

97 

.001 

.001 

.001 

.220 

.001 

.001 

.uOi 

WEAPONS  DELIVERY 

31 

.005 

.005 

.005 

.352 

.005 

.005 

.005, 

ECM 

13 

.001 

.001 

.236 

.236 

.236 

.001 

.001 

38 


* i 


TK  * 

r >- 

* . 


t. 

t 


o 

D 

0 

0 

li 


0 


E 


Table  4 

FIGHTER-BOMBER  MISSION  ESSENTIAL  SUBSYSTEM  OPERATING  TIMES 


MISSION 

ESSENTIAL 

SUBSYSTEMS 

t|(J)  (Hours) 

1 

2 

3 

FHASES 

4 

5 

6 

7 

AIRFRAME 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

LANDING  GEAR 

.33 

0.00 

0.00 

0.00 

0.00 

0.00 

.17 

FLIGHT  CONTROLS 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

ESCAPE  CAPSULE 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

PROPULSION 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

AIR  CONDITIONING 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

ELECTRICAL  POWER 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

LIGHTING 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

HYDRAULIC/ PNEUMATIC 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

FUEL 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

OXYGEN 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

MISC  UTILITIES 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

INSTRUMENTS 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

AUTO  PILOT 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

HF  COMMUNICATIONS 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

UHF  COMMUNICATIONS 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

INTERPHONE 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

IFF 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

RADIO  NAVIGATION 

.33 

.25 

‘ .67 

.17 

.50 

.25 

.17 

BOMB/NAVIGATION 

.33 

.25 

.67 

.17 

.50 

.25 

.17 

FIRE  CONTROL 

.33 

0.00 

0.00 

.17 

0.00 

0.00 

0.00 

WEAPONS  DELIVERY 

.33 

0.00 

0.00 

.17 

0.00 

0.00 

0.00 

ECM 

.33 

.25 

.6? 

.17 

.50 

0.00 

0.00 

39 


y? 


*'y 

. I / 


I 


The  probability  that  a particular  subsystem  successfully  performs  its 
function  during  a particular  phase  is  given  by  Equation  (III -6a) . For  example, 
the  probability  that  the  Airframe  subsystem  successfully  completes  its  function 
during  Phase  1 of  the  mission  is 


Similar  calculations  are  made  for  each  subsystem  for  each  phase.  These  results 
are  displayed  In  the  first  7 columns  of  Table  5. 

The  probability  that  a particular  subsystem  successfully  completes  its 
function  throughout  the  entire  mission  is  given  by  Equation  ( 1 1 1 -7 ) . For  example, 
the  probability  that  the  Airframe  subsystem  successfully  completes  the  mission  is 


Similar  calculations  are  made  for  the  other  subsystems,  and  these  results  are 
displayed  in  the  last  column  of  Table  5. 


The  MCSP  for  the  interdiction  mission  depicted  in  Figure  7 is  given  by 
Equation  (II 1-8), 


= exp 


= exp 


(.33M.003) 


(III-ll) 


= .9999 


p(°) 


L 


= ( .99S9)7 


( 1 1 1 -1 2) 


.9993 
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Table  5 

FIGHTER-BOMBER  BASELINE  SYSTEM  MCSP  RESULTS 


■> 


MISSION 

Pj0)(j) 

p(0) 

*1 

1 

ESSENTIAL 

SUBSYSTEMS 

1 

2 

3 

PHASES 

4 

5 

6 

7 

AIRFRAME 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9993 

LANDING  GEAR 

.9903 

1.0000 

1.0000 

1 .0000 

1.0000 

1.0000 

.9951 

.9855 

FLIGHT  CONTROLS 

.9870 

.9908 

.8756 

.9939 

.9816 

.9994 

.9996 

.9305 

ESCAPE  CAPSULE 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9993 

PROPULSION 

.9949 

.9962 

.9898 

.9974 

.9923 

.9998 

.9998 

.9705 

AIRCONDITIONING 

.9998 

.9998 

.9996 

.9999 

.9997 

.9998 

.9999 

.9985 

ELECTRICAL  POWER 

.9962 

.9971 

.9924 

.9981 

.9943 

.9998 

.9999 

.9780 

LIGHTING 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9993 

HYDRAULIC/PNEUMATIC 

.9850 

.9887 

.9702 

.9925 

.9775 

.9997 

.9998 

.9162  ‘ 

FUEL 

.9996 

.9997 

.9992 

.9998 

.9994 

.9997 

.9998 

.9972 

OXYGEN 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9993 

MISC  UTILITIES 

.9999 

.9999 

.9999 

.9999 

.9399 

.9999 

.9999 

.9993 

INSTRUMENTS 

.9998 

.9«98 

.9995 

.9999 

.9996 

.9998 

.9999 

.9983 

AUTO  PILOT 

.9987 

.9990 

.9974 

.9994 

.9981 

.9990 

.9994 

.9910 

HF  COMMUNICATIONS 

.9967 

.9975 

.9934 

.9983 

.9950 

.9999 

.9999 

.9808 

UHF  COMMUNICATIONS 

.9969 

.9977 

.9938 

.9985 

.9954 

.9999 

.9999 

.9822 

INTERPHONE 

.9980 

.9985 

.9960 

.9990 

.9970 

.9999 

.9999 

.9884 

IFF 

.9994 

.9980 

.9948 

.9987 

.9961 

.9999 

.9999 

.9849 

RADIO  NAVIGATION 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9999 

.9993 

BOMB /NAVI GAT ION 

.9592 

.9692 

.9200 

.9794 

.9592 

.9992 

.9994 

.8024 

FIRE  CONTROL 

.9999 

1.0000 

1.0000 

.9996 

1.0000 

1.0000 

1 .0000 

.9995 

WEAPONS  DELIVERY 

.9999 

1 .0000 

1.0000 

.9981 

1.0000 

1.0000 

1 .0000 

.9980 

ECM 

.9999 

.9999 

.9880 

.9970 

.9910 

1.0000 

1.0000 

.9760 

Pj0)(j) 

.9031 

.9330 

.8278 

.9432 

.8898 

.9952 

.9916 

.5777 

Pc0)(n) 

.9031 

.8426 

.6975 

.6579 

.5854 

.5826 

.5777 
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P(0)  * TT  pi0)  " *5777 

i'-S1 

This  value  Is  the  product  of  the  entries  In  the  last  column  of  Table  5. 

Sometimes  It  Is  of  Interest  to  examine  the  system  MCSP  on  a phase-by- 
phase basl-.  This  can  be  calculated  by 

p<°>u>  - |i[p|0,U>  • 

1 = 1 

where  the  notation  P*o)(j)  has  been  Introduced  to  designate  the  system  MCSP  for  a 
particular  phase.  These  values  were  calculated  for  this  example  and  are  dis- 
played in  the  next  to  last  row  in  Table  5.  Also  of  interest  Is  the  cumulative 
MCSP  for  the  entire  system  up  through  any  phase  n.  This  is  given  by 

P<0)(n)  =fjp£0)(j)  . (III'15) 

j = 1 

These  values  are  displayed  in  the  last  row  of  Table  5 where  the  system  MCSP  is 
obtained  for  n = Np. 

The  MCSP  value  (.5777)  obtained  in  this  example  should  be  Interpreted 
very  carefully.  It  is  strictly  a measure  of  system  reliability  for  this 
particular  mission  and  does  not  measure  mission  effectiveness.  (MCSP  results 
would  generally  be  used  as  inputs  in  effectiveness  calculations.)  The  results 
indicate  that,  on  the  average,  approximately  58  percent  of  the  attack  force 
would  complete  the  mission  without  any  serious  failures.  This  part  of  the  force 
would  be  expected  to  destroy  their  targets  to  the  level  commensurate  with  their 
weapons  and  delivery  conditions.  This  does  not  necessarily  mean  that  the  other 
42  percent  of  the  force  inflict  no  damage  at  all.  On  the  average,  42  percent  of 
the  force  would  be  operating  with  certain  equipments  in  degraded  modes.  However, 
depending  on  the  particular  malfunctions,  and  the  skill  and  ingenuity  of  the  air- 
crew, significant  target  destruction  would  also  be  accomplished  by  this  portion 

of  force. 


, 
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Table  5 lists  the  subsystem  reliabilities  defined  in  terms  of  MCSP  along 
with  the  overall  system  MCSP.  The  next  output  of  the  MCSP  model  is  the  critical 
subsystem  ranking.  As  discussed  previously,  pj0^  is  the  probability  that  a sub- 
system successfully  performs  its  function  during  a mission.  Thus, 

1 - P<o)  (1 11-16) 

Is  the  probability  that  the  mission  is  unacceptably  degraded  because  of  subsystem 
i experiencing  a critical  failure  during  the  mission.  The  critical  subsystem 
ranking  is  obtained  by  subtracting  the  pj0^  values  in  the  last  column  of  Table  5 
from  unity  and  then  ordering  the  values  obtained.  Thus  for  the  Bomb/ Navi  gat ion 
subsystem 


1 - p|o)  = 1 - .8024  *=  .1976  . ( 1 1 1 -1 7 ) 

Similar  values  were  obtained  for  the  other  subsystems,  and  these  values  were  then 
ranked  as  shown  in  Table  6.  For  comparison  purposes,  the  mission  essential  sub- 
systems for  this  example  are  ranked  by  MTBF  on  the  left  hand  side  of  the  table. 
Table  6 clearly  shows  that  the  Bomb/Navigation  subsystem  has  the  greatest  impact 
on  mission  success.  Perhaps,  this  would  have  also  been  evident  simply  on  the 
basis  of  its  low  MTBF  value  and  its  mission  essential  functions,  and  therefore 
analytical  techniques  would  not  be  necessary  to  generate  this  type  of  information. 
However,  the  MCSP  methodology  not  only  quantifies  a subsystem's  impact  on  mission 
success;  but  in  addition,  the  critical  subsystem  ranking  is  the  best  indicator  of 
the  effect  a subsystem  will  have  on  the  mission  from  a reliability  standpoint. 

This  is  demonstrated  in  Table  6,  where  the  subsystem  MT3F  ranking  agrees  with  the 
criticality  ranking  only  for  the  Bomb/Navigation  subsystem.  The  significance  of 
this  type  of  comparison  is  readily  seen  in  the  case  of  the  Hydraul ic/Pneunatic 
subsystem  which  is  ranked  seventh  by  MTBF  but  second  by  mission  criticality. 

Hence,  this  MCSP  model  output  identifies  those  subsystems  whose  Improvement  most 
enhances  probability  of  mission  completion,  and  the  subsystems  so  identified  are 
not  necessarily  those  with  lowest  MTBF. 


Table  6 

FIGHTER-BOBBER  MTBF  AND  CRITICAL  SUBSYSTEM  RANKING 


MTBF  RANKING 

CRITICAL  SUBSYSTEM  RANKING 

RANK 

SUBSYSTEM 

MTBF 

(Hrs) 

RANK 

SUBSYSTEM 

—4 

1 

-j. , — . 

O 

1 

BOMB/NAVIGATION 

6 

1 

BOMB  NAVIGATION 

.1976 

2 

FLIGHT  CONTROLS 

10 

2 

HYDRAULIC/PNEUMATIC 

.0838 

3 

LANDING  GEAR 

13 

3 

FLIGHT  CONTROLS 

.0695 

4 

ECM 

13 

4 

PROPULSION 

.0295 

5 

AIRFRAME 

14 

5 

ECM 

.0240 

6 

AUTO  PILOT 

14 

6 

ELECTRIC  POWER 

.0220 

7 

HYDRAULIC/PNEUMATIC 

18 

7 

HF  COMMUNICATIONS 

.0192 

8 

INSTRUMENTS 

19 

8 

UHF  COMMUNICATIONS 

.0178 

9 

LIGHTING 

20 

9 

IFF 

.0151 

10 

FUEL 

21 

10 

LANDING  GEAR 

.0145 

11 

AIR  CONDITIONING 

22 

11 

INTERPHONE 

.0116 

12 

ESCAPE  CAPSULE 

29 

12 

AUTO  PILOT 

.0090 

13 

WEAPONS  DELIVERY 

31 

13 

FUEL 

.0028 

14 

PROPULSION 

32 

14 

WEAPONS  DELIVERY 

.0020 

15 

RADIO  NAVIGATION 

42 

15 

INSTRUMENTS 

.0017 

16 

UHF  COMMUNICATIONS 

43 

16 

AIR  CONDITIONING 

.0015 

17 

ELECTRIC  POWER 

48 

17 

AIRFRAME 

.0007 

18 

OXYGEN 

63 

18 

ESCAPE  CAPSULE 

.0007 

19 

HF  COMMUNICATIONS 

68 

19 

MISC  UTILITIES 

.0007 

20 

MISC  UTILITIES 

70 

20 

LIGHTING 

.0007 

21 

IFF 

80 

21 

OXYGEN 

.0007 

22 

INTERPHONE 

81 

22 

RADIO  NAVIGATION 

.0007 

23 

FIRE  CONTROL 

97 

23 

FIRE  CONTROL 

.0005 
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The  final  output  of  MCSP  modeling  is  the  sensitivity  analysis,  a sample 

of  which  Is  shown  in  Figure  8.  The  MTBFs  of  the  two  most  critical  subsystems  are 

varied  up  to  twice  their  baseline  values,  and  corresponding  MCSP  calculations 
using  Expression  (II 1-9)  are  made.  (The  Input  data  for  the  other  mission  essential 
subsystems  are  held  constant  at  the  baseline  values.)  The  MCSP  enhancement  due 
to  MTBF  improvement  of  the  Bomb/Navigatlon  and  Kydraulic/Pneumatlc  subsystems  Is 
considered  separately  and  in  combination.  For  comparison  purposes,  the  sensiti- 
vity analysis  has  also  been  performed  for  the  Weapons  Delivery  subsystem  which  is 

seen  to  have  virtually  no  impact  on  total  system  MCSP  enhancement.  This  might  at 

first  seem  somewhat  surprising  since  the  Weapons  Delivery  subsystem  performs  such 
an  important  function  durino  the  mission  and  its  MTBF  is  lower  than  some  of  the 
other  subsystems  which  are  ranked  higher  in  terms  of  mission  criticality.  The 
answer,  of  course,  lies  in  the  total  operating  time  of  the  Weapons  Delivery  sub- 
system which  is  considerably  less  than  the  operating  times  for  the  Bomb/Naviga- 
tion and  Hydraulic/Pneumatic  subsystems.  This  emphasizes  the  dependence  of  MCSP 
on  the  interrelationship  of  MTEf , failure  criticality,  and  operating  time,  i.e., 
all  three  of  the  above  parameters  must  be  considered  and  focusing  on  only  one, 
such  as  MTBF,  can  sometimes  be  very  misleading. 

Another  important  result  of  the  type  of  analysis  displayed  in  Fiqure  8 is 
the  establishment  of  realistic  reliability  goals  for  the  individual  subsystems  as 
well  as  the  total  system.  For  example,  the  MCSP  curve  due  to  Improvements  in  the 
MTBF  of  the  Hy^.-aul  i c/Pneumatic  subsystem  has  essentially  leveled  off  for  MTBF 
Increases  above  80  percent  of  the  baseline  value.  This  establishes  a realistic 
MTBF  value  for  this  subsystem  for  this  mission.  When  similar  sensitivity  analyses 
are  performed  for  al 1 the  mission  essential  subsystems,  realistic  MTBF  levels  can  be 
determined  for  all  subsystems  which  in  turn  establishes  the  most  realistic  MTBF 
for  the  entire  system.  The  sensitivity  analysis  curve  for  many  of  the  subsystems 
will  be  similar  to  that  cf  the  Weapons  Delivery  subsystem  which  indicates  that 
the  Baseline  System  MTBrs  for  these  subsystems  are  already  adequate  for  the  mission. 
It  should  be  emphasized  that  these  sensitivity  results  are  very  much  dependent  on  the 
particular  mission  considered.  Therefore,  in  practice,  the  most  stringent  mission 
that  the  equipment  is  expected  to  perform  should  be  used  with  the  sensitivity  analysi 
in  the  establishment  of  realistic  MTBF  goals. 
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F.  CONCLUSION 


- 


This  section  has  presented  the  development  of  the  MCSP  methodoloqy  alonq  with 
examples  of  applications  of  the  methodology.  From  the  diversity  of  the  examples, 
it  is  readily  apparent  that  the  methodology  has  wide  applicability  and  can  provide 
Proaram  Manaqers  and  Decision  Makers  with  valuable  information  on  the  operational 
suitability  of  their  system  from  a reliability  standpoint. 

The  next  section  extends  this  methodoloqy  to  include  a procedure  for 
optimally  allocating  resources  whenever  reliability  improvement  options  are  avail- 
able. 


SECTION  IV 


DESIGNING  TO  SYSTEM  PERFORmmNCE/COST  MODEL 


A.  GENERAL 


The  DSPC  model  was  briefly  described  In  Section  II-C.  This  model  selects 
from  a group  of  candidate  components  and  subsystems  those  to  be  most  effec- 
tively Integrated  Into  a system  design.  The  various  candidate  components  and 
subsystems  represent  options  that  enable  the  program  engineer  to  establish 
different  levels  of  operational  capability  and  reliability  associated  with  the 
characteristics  and  cost  of  the  specific  options.  The  DSPC  model  can  be  used 
In  the  preliminary  design  of  weapon  systems.  In  common  practice,  preliminary 
design  activities  have  concentrated  on  selecting  components  and  subsystems  to 
develop  a baseline  design  that  would  assure  required  operational  capabilities, 
such  as  speed,  payload,  range,  guidance  accuracy,  etc.  It  became  common 
practice  to  make  design  tradeoffs  between  capability  and  cost  before  the  design- 
to-cost  concepts  were  implemented.  With  cost  In  DTC  defined  to  mean  Life  Cycle 
Costs,  new  emphasis  must  be  placed  on  system  reliability  since  it  Is  a major 
factor  In  determining  the  operating  and  maintenance  costs  throughout  the  life 
of  the  system. 

The  MCSP  model  was  .Initially  developed  to  show  the  impact  of  reliability 
on  operational  capability  and  to  show  the  reliability  growth  of  the  total 
system  as  the  system  matured.  The  DSPC  methodology  Is  based  upon  MCSP  as  the 
measure  of  merit  to  be  used  to  relate  cost  and  reliability  to  an  Indicator  of 
operational  capability.  Since  the  DTC  approach  has  been  applied  to  systems  In 
various  phases  of  the  acquisition  cycle,  the  DSPC  model  has  most  frequently  been 
used  to  consider  reliability  Improvement  of  an  existing  or  baseline  design  as 
a means  to  reduce  operation  and  maintenance  cost  and  hence  life  cycle  cost. 

Thus,  the  DSPC  methodology  will  usually  be  referred  to  In  its  application  to 
system  reliability  improvement. 

The  mathematics  of  the  DSPC  model  must  be  easily  understood  and  employed 
in  order  to  be  o*  value  to  a System  Program  Manager  or  project  engineer.  For 
this  reason.  In  addition  to  the  mathematical  description,  some  numerical 
examples  will  be  worked  out  In  detail  to  clarify  the  step-by-step  calculations 
required  to  develop  the  DSPC  curve  illustrated  in  Figure  2,  page  15.  The  DSPC 
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curve  Is  defined  by  a series  of  vertex  points  each  of  which  corresponds  to  a 
unique  combination  of  subsystem  options  that  produces  the  maximum  MCSP  for  the 
associated  cost.  This  combination  associated  with  a vertex  point  Is  called  an 
optimal  system  configuration.  The  detailed  examples  should  clarify  the  proce- 
dures so  that  program  engineers  can  apply  the  methodology  to  their  particular 
system. 

B.  SUBSYSTEM  RELIABILITY  IMPROVEMENT  OPTIONS 

Weapon  system  capability,  complexity,  and  cost  have  increased  dramatically. 
As  complexity  has  increased  reliability  has  become  a real  concern  because,  no 
matter  how  well  a system  meets  operational  requirements,  it  Is  of  little  value 
if  it  cannot  complete  the  mission  when  it  is  needed.  Neither  Is  It  of  value  if 
the  cost  to  purchase  It  or  the  cost  to  maintain  it  are  not  affordable.  The 

OSPC  methodology  provides  a means  to  assess  total  system  reliability  and  invest- 
ment to  improve  reliability. 

In  order  to  use  the  DSPC  methodology,  it  is  necessary  to  assume  that  a 
Baseline  System  has  been  configured  and  that  it  meets  some  threshold  of  opera- 
tional performance.  Given  that  the  Initial  design  or  Baseline  System  meets 
operational  requirements  but  a low  MCSP  indicates  questionable  reliability,  it 
may  be  necessary  to  Initiate  a reliability  improvement  program.  Reliability 
improvement  techniques  include  the  following: 

. Screening  - Screening  entails  replacing  low  reliability  components  with 
higher  reliability  components.  This  is  usually  accomplished  by  test  selection 
in  which  higher  performance  criteria  are  imposed  in  testing  than  the  component 
is  expected  to  encounter  in  the  intended  operation. 

• Design  Modification  - In  this  technique  minor  changes  are  made  In  the 
subsystem  design.  These  include  such  things  as  substituting  an  integrated 
circuit  for  a number  of  discrete  parts,  etc. 

• Environmental  Protection  - Environmental  protection  Involves  such  things 
as  the  installation  of  shock  mounts,  climate  controlled  compartments,  etc. 
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• Redundancy  - When  volume  and  weight  constraints  allow,  duplicate  or  back- 
up subsystems  can  be  Installed. 

■1  ' V i * - r-  r : *'->*_/  r'*  , ~ - -• ,L*  * vj? 

• Subsystem  Redesign  - Subsystem  redesign  involves  development  of  a 
completely  new  subsystem  to  perform  the  required  function,  or  major  modifications 
in  the  design  of  an  existing  subsystem. 


The  various  reliability  levels  (subsystem  performance)  and  their  correspond- 
ing costs  constitute  the  subsystem  options.  For  subsystems  operating  over  a 
period  of  time,  the  reliability  improvement  options  are  obtained  by  Increasing 
the  MTBF  (over  the  baseline  values).  For  single  event  subsystems,  the  reliability 
improvement  options  are  obtained  by  increasing  the  number  of  successes  per  number 
of  trials  (over  the  baseline  values).  For  pseudo-subsystems,  the  reliability 
improvement  options  are  obtained  by  increasing  the  performance  of  pseudo-sub- 
system elements.  It  Is  assumed  at  this  point  that  the  Program  Manager  has 
received  options  for  some  of  the  mission  essential  subsystems  in  the  form  of  cost 
and  performance  estimates  which  define  each  option. 


To  implement  the  OSPC  model,  the  subsystem  reliability  improvement  options 
must  oe  quantified.  This  necessitates  the  introduction  of  the  following  notation: 


co 


o 

(o) 


MCSP  of  the  Baseline  System. 

Unit  acquisition  cost  of  the  Baseline  System. 


1 


Unit  acquisition  cost  of  the  i-th  essential  subsystem  of  the 
Baseline  System. 
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= Number  of  options  available  for  subsystem  i. 


Probability  that  the  t-th  option  (1*1.2*...,  n(i)) 
for  subsystem  i completes  its  required  function 
(independent  of  the  other  subsystems). 


Unit  acquisition  cost  of  the  t-th  option  (1*1,2, 
...»  n( 1 ) ) for  subsystem  1. 
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PCj  5 MCSP  of  t^,e  system  configuration  corresponding  to  the 
J-th  optimal  vertex  point  of  the  DSPC  curve. 

C.:  = Unit  acquisition  cost  of  the  system  configuration  cor- 

J t 

responding  to  the  j-th  optimal  vertex  point  of  the  DSPC 
curve. 

As  can  be  seen  by  the  above  notation,  the  DSPC  model  will  be  developed  in  terms 
of  acquisition  costs.  This  is  the  simplest  manner  in  which  to  Illustrate  the 
methodology.  However,  the  same  DSPC  optimization  procedure  is  applicable  when 
the  above  costs  are  defined  as  acquisition  costs  plus  logistics  support  costs 
or  life  cycle  costs. 

To  clarify  this  notation,  the  symbols 

P*.2)  and  C<2>  (IV-1) 

denote  the  second  reliability  improvement  option  for  subsystem  (or  pseudo-sub- 
system) i. 

Since  n(i)  denotes  the  number  of  options  available  for  subsystem  i,  n(i)  = 0 
when  only  the  baseline  subsystem  i is  available,  i.e.,  no  reliability  improvement 
options  for  that  subsystem.  In  this  section,  the  only  Interest  is  in  those  sub- 
systems for  which  n(i)  > 0.  Therefore,  for  each  subsystem  (or  pseudo-subsystem) 
having  reliability  improvement  options,  the  values  of  performance  and  cost 

pj&)  and  C^}  (t  - 1,  2.  ....  n(1))  (IV-2) 

define  these  options. 

C.  ADJUSTED  BASELINE  SYSTEM 

Before  applying  the  DSPC  algorithm,  it  is  necessary  to  determine  if  the  Base- 
line System  can  be  adjusted.  The  adjustment  of  the  Baseline  System  merely  amounts 
to  checking  the  options  for  each  subsystem  to  determine  if  any  of  those  options 
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yield  higher  or  equal  performance  at  lower  cost  or  higher  performance  at  equal 
cost.  If  such  an  option  exists,  then  that  baseline  subsystem  is  replaced  by  the 
lowest  cost  option.  Although  this  can  be  done  by  inspection,  the  process  will  be 
described  mathematically.  As  mentioned  previously,  such  options  could  occur  if, 
for  instance,  the  subsystem  designer  discovers  a means  to  reduce  the  unit  cost  of 
tne  subsystem  or  to  improve  the  subsystem  at  either  the  same  or  a lower  unit  cost. 

(If  life  cycle  cost  is  considered,  the  cost  of  improving  subsystem  reliability 
sometimes  is  more  than  compensated  for  by  the  resulting  reduction  in  logistic 
support  cost  (Reference  3).)  The  simple  procedure  for  adjusting  the  Baseline  Sys- 
tem (when  possible)  will  now.be  described  mathematically. 

The  first  step  \s  to  enumerate  the  options  in  (IV-2)  such  that  values  of  the 
subsystem  performance  options  are  ordered  as  follows: 

pi°)  < pj1)  < p|2>  < ...  < P^n( 1 ) ) . (IV-3) 

It  is  conceivable  that  .one  or  more  of  the  options  (IV-2)  has  the  property  that 

for  some  value  of  l > 0 ! 

c|£)  < C<o)  , (IV-4) 

which  means  (because  of  the  ordering  (IV-3))  that  better  (or  the  same)  subsystem 
performance  is  achievable  at  a lower  or  equal  cost  than  the  baseline  subsystem. 

For  each  subsystem  having  options  with  the  property  (IV-4),  the  baseline  sub- 
system with 

p{°*  and 

should  be  replaced  by  that  option  for  which  is  a minimum.  If  min{cj^} 
occurs  for  more  than  one  value  of  £.,  then  that  option  for  which  £ is  a maximum 
should  be  selected  since  (because  of  the  ordering  (IV-3))  this  provides  the 
maximum  performance  at  that  cost.  The  test  (IV-4)  should  be  made  for  all  subsystems,  ji 
for  which  options  are  available  followed  bv  adjustments  of  the  Baseline  System 
as  required. 


53 
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where  N$  denotes  the  number  of  mission  essential  subsystems  and  k(i)  denotes  the 
option  selected  in  the  adjustment  of  subsystem  i.  If  k(1)  « 0,  then  either  sub- 
system t was  unchanged  in  the  baseline  adjustment  or  subsystem  1 had  no  options. 
Notice  that  for  these  subsystems,  the  corresponding  term  in  the  product  of  Equa- 
tion (IV-7)  is  1,  and  in  Equation  (IV-8)  the  corresponding  term  In  the  sum  Is  0; 
hence,  these  subsystems  have  no  effect  on  the  calculation  of  PcJ  or  C1 . There- 
fore, only  those  subsystems  for  which  k(i)  >0  have  an  effect  on  Equations  (IV-7) 
and  (IV-8). 

After  adjusting  the  original  Baseline  System  (when  possible),  the  DSPC  algo- 
rithm can  be  appl ied. 

0.  OPSC  CALCULATION  PROCEDURE 

Let  Pcl  and  C]  denote  the  MCSP  and  cost  of  the  Adjusted  Baseline  System.  This 
defines  the  first  optimal  vertex  point  of  the  DSPC  curve.  If  the  inequality  (IV-4) 
was  not  satisfied  for  any  subsystem,  then  no  adjustment  was  made  and 


Since  k(i)  was  the  option  selected  for  subsystem  i for  the  Adjusted  Baseline 
System, 


n(i),  then  there  are  no  remaining  options  for  subsystem  i.  If  k(i)  < n(i),  then 
the  remaining  options  for  subsystem  i are 


P 


co 


C 


C. 


o 


( IV— 9) 


p(k(i)) 


c(«i» 


(IV-10) 


are  the  new  adjusted  baseline  values  for  subsystem  i (i  = 1,2 N$).  If 

k(i)  = 0,  then  subsystem  i was  unchanged  in  the  baseline  adjustment.  If  k(i)  = 


• • • l 


Ns).  If 
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t » (k(1)  + 1).  (k(1)  + 2) 


(n(1)) 


(IV-11) 


at  cost  cj*^. 

The  DSPC  algorithm  will  now  be  applied  to  those  subsystems  having  remaining  op- 
tions (IV-U),  i.e.,  k(i)  < n(i). 

The  detailed  mathematical  proof  of  the  DSPC  optimization  algorithm  is  docu- 
mented In  Reference  3.  Only  the  step-by-step  procedure  for  calculating  the  opti- 
mal vertex  points  of  the  DSPC  curve  will  be  described  mathematically  in  the  follow- 
ing few  pages.  Actually  it  Is  very  simple  to  apply  the  DSPC  methodology,  although 
the  mathematical  notation  necessary  to  describe  the  general  procedure  at  first  may 
appear  complex.  However,  the  simplicity  of  the  procedure  will  be  made  clear  by 
means  of  some  detailed  numerical  examples  in  Section  IV-E. 

The  first  optimal  vertex  point  of  the  DSPC  curve  corresponds  to  the  Adjusted 
Baseline  System  or,  if  no  adjustments  were  possible,  to  the  original  Baseline 
System.  This  first  vertex  point  is  the  starting  point  for  the  DSPC  optimization 
algorithm.  The  DSPC  methodology  will  first  be  applied  to  determine  the  second 
vertex  point,  and  then  the  general  procedure  for  continuing  the  process  will  be 
described. 

The  option  selected  for  subsystem  i for  the  first  vertex  point  is  denoted  by 
k(1).  If  no  adjustment  was  made  for  subsystem  1,  then  k(i)  = 0 (i.e.,  subsysten 
i remains  at  its  baseline).  For  each  subsystem  having  additional  options  (i.e., 
k(i)  < n(i)),  the  DSPC  procedure  requires  that  a set  of  weighting  factors  be  cal- 
culated for  each  such  subsystem.  These  factors  merely  attach  a value  in  substitut- 
ing the  present  adjusted  baseline  option  k(i)  for  subsystem  1 by  each  of  its  re- 
maining options  k(i)  + 1,  k(i)  + 2,  ....  n(1).  It  is  necessary  to  evaluate  the 
weights  corresponding  to  the  selection  of  each  of  the  remaining  options  since  the 
next  option  (k(i)  + 1)  is  not  necessarily  the  best  selection  to  be  made  next  for 
subsystem  i.  In  other  words.  It  may  be  better  to  skip  over  one  or  more  consecutive 
options.  The  optimal  option  to  be  selected  next  for  subsystem  1 is  determined  by 
that  option  having  the  highest  weight.  The  procedure  for  determining  the  second 
vertex  point  is  as  follows: 


/I 

a.  For  those  subsystems  for  which  k(i)  < n(i),  calculate  for  each  of  the  re- 
maining options  for  that  subsystem  (t  * k(i)  + 1,  k(i)  + 2,  ....  n(i))  the  weight- 


These  values  of  A^  attach  a weight  (value)  in  replacing  the  option  k(i)  of  the 
first  vertex  point  by  each  of  the  remaining  options  for  subsystem  i (there  are 
n(i)-k(i)  remaining  options  for  subsystem  i). 

b.  Considering  only  subsystem  i,  the  optimal  option  to  be  selected 
next  for  that  subsystem  is  determined  by  that  value  of  l (the  option  number)  for  • / 

which  the  weighting  factor  (IV-12a)is  a maximum.  Let  the  maximum  weighting  factor  ! * 

for  subsystem  i be  denoted  by  A.. (2),  i.e.,  ; ^ 


and  let  fc(i,  2)  denote  that  value  of  fc  for  which  A^£  in  (IV-13)  is  a maximum.  The 
number  2 in  the  symbols  A. (2)  and  t(i,  2)  are  used  only  to  specify  that  the  second 
vertex  point  is  being  calculated.  The  value  A. (2)  attaches  a weight  to  the  opti- 
mal selection  of  the  next  option  for  subsystem  i,  and  the  corresponding  value 


ing  factors 


A 


it 


where 


(IV-12b) 


and 


c(0  _ CW)) 


(IV-12c) 


M 2) 


max 


(IV-13) 


k(i)  < SL  <_  n(i) 


t(i,  2)  defines  that  optimal  option  with  the  highest  weight.  In  other  words 
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where 


l * 1(1,  2) 


c.  The  set  of  A^(2)  values  together  with  the  corresponding  option  t(i,  2) 
was  determined  above  for  each  subsystem  having  options  remaining.  The  subsystem 


subsystem  having  the  maximum  A^(2)  value  (i  = 1,  2,  ....  N$).  Let  s(2)  denote 


the  subsystem  selected  where  &(s(2),  2)  defines  the  optimal  option  for  subsystem 
s( 2) . The  optimal  option  t(s(2),  2)  for  subsystem  s(2)  then  replaces  that  option 
subsystem  s(2)  had  at  the  first  vertex  point.  This  then  defines  the  system  con- 
figuration for  tjha  second  vertex  point.  Only  an  option  for  one  subsystem  wcs 
changed  in  the  process. 


d.  The  MCSP  and  cost  corresponding  to  the  second  vertex  point  are  deter- 
mined (as  in  Equation  (IV-6))  by 


where  the  value  of  i = s(2)  to  be  substituted  in  Equations  ( IV-1 4a ) and  ( I V-l 4b) 
was  determined  in  step  c above. 


for  which  a different  option  is  selected  for  the  second  vertex  point  is  that 


and 


If,  for  instance 


A3(2)  = max{Ai(2)}  = A32 


( I V-l 5) 
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A 


then  t(3,  2)  * 2,  and  option  2 for  subsystem  3 Is  selected  for  that  vertex  point 
following  the  Adjusted  baseline  System;  the  other  subsystems  remain  unchanged. 

In  this  case,  the  corresponding  values  of  MCSP  and  cost  for  the  second  vertex 
point  would  be 


To  describe  the  general  procedure,  suppose  the  m-th  vertex  point  has  been  de- 
termined. This  means  that, for  that  vertex  point, the  MCSP  and  cost  are  known  as 
well  as  the  associated  optimal  combination  of  subsystem  options.  These  values 
were  determined  for  m = 2 as  described  above.  The  procedure  must  now  be  continued 
to  determine,  in  sequence,  the  vertex  points  3,  4,  5,  ....  etc.  The  procedure  for 
determining  the  next  (i.e.,  the  {m  + l)-st)  vertex  point  is  as  follows: 


a.  The  subsystem  replaced  in  defining  the  configuration  for  the  m-th  ver- 


tex point  was  determined  by  selecting  that  subsystem  which  yielded  the  maximum 
of  a set  of  weighting  factors  (A^(m)}.  Let  s(m)  denote  that  subsystem  selected 
for  the  m-th  vertex  poirt,  and  let  t(s(m),  m)  denote  the  optimal  option  selected 
for  that  subsystem.  To  determine  the  (m  + 1 ) -st  vertex  point,  a new  set  of 
weighting  factors  must  be  determined.  The  only  subsystem  changed  in  going  from  the 
(m  - 1 ) -st  to  the  m-th  vertex  point  was  subsystem  s(m).  Therefore,  the  only  change 
in  the  set  of  weighting  factors  { X - (m  + 1)}  required  to  determine  the  (m  + 1 ) -st 
vertex  point  is  that  weighting  factor  corresponding  to  subsystem  s(m).  The  new 
weighting  factor  for  subsystem  s(m)  is  determined  as  follows: 


and 


( I V-l 6b) 


(1)  If  £(s(m),  m)  = n(s(m)),  then  there  are  no  options  remaining  for 
subsystem  s(m) , and  + 1)  is  set  equal  to  0. 
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(2)  If  l(s(m),  m)  < n(s(m)) , then  there  are  options  remaining  for 
subsystem  s(m).  In  a manner  analogous  to  the  procedure  described  for  determining 
the  second  vertex  point,  a set  of  weighting  factors  for  subsystem  s(m)  is  calcu- 
lated for  the  remaining  options  t ■ t(s(m),  m)  + 1,  t(s(m),  m)  + 2,  ....  n(s(m)) 
by  setting 

1 * s(m) 

k(1)  = t(s(m),  m)  (IV-17) 

in  Equation  (IV-12).  The  new  weighting  factor  + 1)  for  subsystem  s(m)  (re- 

quired to  determine  the  (m  + l)-st  vertex  point)  is  determined  by  the  maximum  of 
the  weighting  factors  for  subsystem  s(m)  calculated  above,  where  Jt(s(m),  m + 1) 
denotes  the  corresponding  optimal  option  for  that  subsystem.  Thus,  the  new 
weighting  factor  for  subsystem  s(m)  is  determined  as  well  as  the  next  optimal 
option  £(s(m),  m + 1)  for  that  subsystem.  Fo**  the  other  subsystems,  no  change  Is 
made,  i .e. , for  i f s(m) 

Aj(m  + 1)  « A.j(m) 

t(1,  m + 1)  = *(1,  m)  . (IV-18) 


Therefore,  the  new  set 


{A^m  + 1)}  ( I V-l  9a) 

and  the  corresponding  set  of  optimal  options 

{t(i , m + 1 ) } ( I V-l 9b) 

are  known,  and  the  (m  + l)-st  vertex  point  can  now  be  determined.  Only  one  member 
(for  i = s(m))  in  the  set  (IV-19a)  and  in  the  set  (IV-19b)  is  different  from  the 
sets  (A.(m))  and  {£(i,  m)}. 


b.  The  subsystem  to  be  selected  for  the  (m  ♦ l)-st  vertex  point  is  deter- 
mined. by  that  value  of  1 for  which  A^m  ♦ 1)  in  (IV-19a)  Is  a maximum.  Letting 


s(m  + 1)  denote  this  subsystem,  the  (m  + l)-st  vertex  point  is  determined  by 
selecting  option  *(s(m  + 1),  m + 1)  for  subsystem  s(m  + 1). 


The  value  of  k is  tne  option  for  subsystem  s(m  + 1)  which  it  had  at  the  m-th  vertex 
point. 

d.  The  process  is  continued  until  no  options  remain  for  any  subsystem. 

In  other  words,  the  above  process  is  applied  for  m = 2 to  determine  the  third 
vertex  point,  then  m is  set  equal  to  3,  4,  5,  ...  to  determine  the  remaining  vertex 
points. 

In  summary,  the  step-by-step  procedure  for  implementing  the  DSPC  methodology 
can  be  described  briefly  as  follows: 


1.  Determine  the  MCSP  of  the  Baseline  System  (Section  III-C)  and  the  unit 
cost  CQ. 


1 r.-'"  , •' 

c.  Thi 


The  MCSP  and  cost  corresponding  to  the  (m  + l)-st  vertex  point  are 


determined  by 


and 


where 


*.  = £(s(m  + 1) , m + 1) 


(IV-20c) 


and 


k * t(s(m  + 1 ) , m) 


(IV-20d) 
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2.  For  each  subsystem  with  options,  order  the  performance  values  (Expression 
(1V-3)). 

3.  Adjust  the  baseline  System  if  possible  (test  IV-4).  This  defines  the 
first  optimal  vertex  point;  the  MCSP  and  cost  are  determined  by  Equations  (IV-7) 

and  (IV-8). 

4.  Calculate  the  set  of  weighting  factors  and  optimal  options  (for  determining 
the  second  vertex  point)  as  described  on  pages  56  to  59.  This  determines  the 
second  vertex  point  where  the  corresponding  values  of  MCSP  and  cost  are  calculated 
by  Equations  (IV-14a)  and  ( IV-1 4b) . 

5.  Determine,  in  sequence,  the  remaining  vertex  points  3,  4,  ...»  etc.  as 
described  on  pages  59  and  50.  (In  going  from  one  vertex  point  to  the  next,  only 
one  weighting  factor  is  changed.) 

It  is  important  to  outline  the  procedure  to  be  followed  in  determining  the 
new  DSPC  curve  when  an  additional  option  becomes  available  for  some  subsystem. 
Suppose  an  additional  option  becomes  available  for  subsystem  i;  this  means  that 
subsystem  i then  has  n(i)  + 1 options.  The  first  step  is  to  order  the  perform- 
ance values  for  that  subsystem  (step  2),  and  then  repeat  steps  3,  4,  and  5. 

This  process  requires  at  most  the  calculation  of  n(i)  + 1 new  weighting  factors 
for  subsystem  i;  the  weighting  factors  for  all  other  subsystems  remain  the  same. 
Therefore,  the  new  DSPC  curve  can  be  determined  very  quickly. 

An  interesting  comment  that  can  be  made  at  Miis  point  is  that  the  optimal 
selection  of  subsystem  options  is  independent  of  the  system  MCSP.  From  Equations 
(IV-12)  it  is  clear  that  the  weight  attached  to  the  selection  of  a subsystem 
option  is  dependent  only  upon  the  relative  improvement  of  the  particular  sub- 
systems and  their  associated  cost. 


— ; 


E DSPC  EXAMPLES 


# 1.  Simplified  Example.  To  clarify  the  step-by-step  DSPC  procedure 
described  above,  the  methodology  first  will  be  applied  In  detail  to  a simple 
hypothetical  numerical  example.  Suppose  a system  consists  of  only  3 essential 
subsystems  where  the  baseline  values  of  performance  and  cost  (In  $ thousands)  of 
the  subsystems  are  presented  in  Table  7. 


Table  7 

BASELINE  SYSTEM 


SUBSYSTEM 

P(o) 

Ki 

c(°) 

ci 

1 

.9418 

24.6 

2 

.9048 

19.0 

3 

.8187 

33.5 

The  first  step  is  to  calculate  the  MCSP  and  cost  of  the  Baseline  System: 

3 

,1, 


CO 


pi 


(o)  = 


(.9418)  (.9048)  (.8187)  * .6976 


( I V-21 a ) 


and 


_3 

1 T 1 


Z 4 


(o) 


24.6  + 19.0  + 33.5  * $77.1 


( I V-21 b) 


If  there  are  other  costs  associated  with  the  Baseline  System  (e.g.,  overhead  cost, 
etc.),  these  are  merely  added  to  the  cost  determined  by  ( I V-21 b) . 


Vw 


V 


\ 


!-N-* 

v- 


X 


to 

V* 
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Suppose  2 options  become  available  for  each  subsystem  where  the  options 
are  defined  In  Table  8. 


Table  8 

SUBSYSTEM  OPTIONS 


SUBSYSTEM 

PERFORMANCE 

UNIT  COST 

1 

.9802 

24.0 

.9632 

19.5 

9 

.9512 

20.0 

C 

.9802 

21.2 

9 

.9299 

44.6 

.8752 

35.0 

The  second  step  Is  to  order  the  options  for  each  subsystem  by  Increasing  perform- 
ance (Expression  ( I V-3) ) . This  then  leads  to  Table  9 which  displays  the  baseline 
values  of  each  subsystem  and  the  proper  ordering  of  the  options. 

Table  9 

COST  AND  MISSION  PERFORMANCE  OF  SUBSYSTEM  OPTIONS 


SUBSYSTEM 
NUMBER  i 

BASELINE 

OPTION  1 

OPTION  2 

p(0) 

c(0) 

p(D 

l 

cO) 

U1 

p(2) 

Ki 

C<2) 

Li 

1 

.9418 

24.6 

.9632 

19.5 

.9802 

24.0 

2 

.9048 

19.0 

.9512 

20.0 

.9802 

21.2 

3 

.8187 

33.5 

.8752 

35.0 

.9299 

44.6 

The  third  step  is  to  determine  if  the  Baseline  System  can  be  adjusted 
(i.e.,  perform  the  test  (IV-4)).  By  inspection.  Option  1 for  subsystem  1 should 
replace  the  baseline  subsystem  1 since  that  option  has  higher  performance  at  a 
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lower  cost.  This  Is  the  only  adjustment  possible.  Thus,  the  Adjusted  Baseline 
S/stem  (the  first  optimal  vertex  point)  consists  of 

Option  1 for  Subsystem  1 , 

Baseline  for  Subsystem  2, 

Baseline  for  Subsystem  3 

The  corresponding  MCSP  and  cost  of  the  Adjusted  Baseline  System  are 

■ 6976(tHt|)  - -''35  (IV-22.) 


* 77.1  + (19.5  - 24.6)  * $72.0  . (IV-22b) 

These  results  show  the  improvement  in  MCSP  at  a reduced  cost  resulting  from  the 
adjustment  of  the  Baseline  System.  The  DSPC  calculations  will  now  be  made  In  a 
step-by-step  fashion  to  determine  the  subsequent  optimal  vertex  points  of  the  MCSP 
versus  cost  curve.  As  mentioned  previously,  the  methodology  does  not  require  the 
evaluation  of  every  conceivable  combination  of  options  which  on  a complex  system 
would  require  a time  consuming  and  prohibitively  costly  computer  analysis.  The 
methodology  allows  a program  engineer  to  quickly  screen  the  options  using  an  elec- 
tronic calculator  to  select  only  those  options  whose  cost/performance  index  justi- 
fies further  consideration. 

I 

The  fourth  step  is  to  determine  the  second  vertex  point.  This  is  the 
beginning  of  the  DSPC  algorithm;  therefore,  the  calculations  of  the  Au  values 
defined  by  Equations  (IV-12)  must  be  made.  Since  Option  1 for  subsystem  1 was 
selected  for  the  Adjusted  Baseline  System  k(l)  = 1,  whereas  k(2)  * k(3)  * 0 since 
no  adjustment  was  possible  for  these  subsystems.  Application  of  Equation  (IV-12) 
yields  the  set: 


C1  3 Co  + <C10)  - Cl0)) 
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N 


V. 


(tM5°l)  ™ " >•«»* 

(jw)’"  ' l0513- 

(js®)2^  “ ’-037'1 

(fir i)1^  ’ , 0455- 
■ 10,15 


( IV-23) 


Therefore,  (from  Equation  ( IV-13) ) taking  the  maximum  value  of  Xi£  for  subsystems 
i = 1 , 2,  3 yields 


*,(2) 

= x12 

= 1.0039, 

A2(2) 

“ X21 

- 1.0513, 

A3(2) 

= X3I 

= 1 .0455 

• 

(IV-24) 

Thus,  the  o«nly  remainino  ootion  for  subsystem  1 (which  already  is  at  Option  1)  is 
Option  2 with  weighting  factor  a12,  for  subsystem  2 Option  1 is  the  next  optimal 
option,  and  Option  1 for  subsystem  3.  The  maximum  of  the  set  (IV-24)  is 


A2(2)  = A 


21 


(IV-25) 
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Therefore,  for  the  second  vertex  point  the  baseline  subsystem  2 should  be  replaced 
by  Option  1 (indicated  by  the  second  subscript  of  A21).  The  system  configuration 
for  the  second  vertex  point  consists  of 


The  determination  of  the  second  vertex  point  is  the  most  time  consuming  step  since 
weighting  factors  for  all  subsystems  had  to  be  calculated.  However,  to  determine, 
in  sequence,  the  remaining  vertex  points  the  weighting  factor  of  only  one  subsys-  ! 
tem  is  changed  in  proceeding  from  one  vertex  point  to  the  next. 

The  fifth  step  is  to  determine,  in  sequence,  the  remaining  vertex  points 
3,  4,  ...  . This  procedure  is  described  starting  on  page  59.  To  calculate  the 
third  vertex  point  set  m = 2;  since  Option  1 for  subsystem  2 was  selected  for  the 
second  vertex  point  s(2)  = 2 (subsystem  selected)  and  e(2,  2)  « 1 (option  selected) 
Therefore,  the  only  weighting  factor  to  be  chanqed  is  that  for  subsystem  2.  Since 
only  one  more  option  remains  for  subsystem  2,  the  new  weighting  factor  for  subsys* 
tem  2 is 


Option  1 for  subsystem  1 
Option  1 for  subsystem  2 
Baseline  subsystem  3. 


The  corresponding  MCSP  and  cost  are 


P 


a 


.7501 


(IV-26a) 


and 


C2  « C,  ♦ (C*1*  - 72.0  +(20.0  - 19.0)  = $73.0  . (IV-26b) 


1 .0253 


(IV-27) 
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and  t(2,  3)  * 2.  Therefore,  for  determining  the  third  vertex  point,  the  new  set 
(with  only  x2(3)  changed}  of  weighting  factors  becomes  (us1ng(  IV-27)and(  IV-24)) 

Xl(3)  * X]2  - 1.0039, 

X2(3)  = X22  ■ 1.0253, 

X3(3)  = X31  * 1.0455  . (IV-28) 

From  the  set  (IV-28),  x^(3)  * x^  is  the  maximum,  and  therefore  Option  1 for  sub- 

system 3 is  selected.  The  system  configuration  for  the  third  vertex  point  is 
therefore 


Option  1 for  subsystem  1 , 
Option  1 for  subsystem  2, 
Option  1 for  subsystem  3 


[I 

0 

D 

n 

o 

o 

0 


> / 


4. 


J 


( 


•y/  ' 


The  MCSP  and  cost  for  the  third  vertex  point  are 


c3 


c2 


(f) 


.7501 


= .8019 


(IV-29a) 


and 


C,  + - C*o))  = 73.0  +(1.5)  « $74.5 


(IV-29b) 


To  determine  the  fourth  vertex  point  set  m = 3 and  s(3)  = 3 (since  subsys- 
tem 3 was  changed  in  the  previous  step)  and  e(3,  3)  * 1 (since  Option  1 was  selec- 
ted for  subsystem  3).  The  new  weighting  factor  to  be  calculated  for  subsystem  3 
is 


X3(4) 


'32 


'.9299  \ 
*.8752  ) 


1 

9T 


1.0063 


( IV-30) 
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From  the  set  (IV-33),  it  follows  that  Option  2 for  subsystem  3 should  be  selected. 
The  system  configuration  for  the  fifth  vertex  point  is  therefore 


Option  1 for  subsystem  1 , 
Option  2 for  subsystem  2, 
Option  2 for  subsystem  3. 


The  MCSP  and  cost  for  the  fifth  vertex  point  are 


and 

C5  = C4  + <C32)  " C31)}  = 75 J + <9-6)  3 585.3 

No  options  remain  for  subsystem  3.  Therefore,  a3(6)  = 0 and  the  new  set 
ing  factors  is 


^(6)  = x12  = 1.0039, 

A2(6)  * 0. 

A3(6)  = 0 

Therefore,  the  only  remaining  selection  is  Option  2 for  subsystem  1,  and 


and 

c6  = c5  + (C{2)  - C0>)  = 85.3  + (4.5)  * $89.8 
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(IV-34a) 

(IV-34b) 
of  weight- 

( IV-35) 

(IV-36a) 

( IV-365) 


/ . 


Table  10  lists  the  configurations  together  with  the  corresponding  values  of  MCSP 
and  cost  as  determined  for  the  above  example  by  means  of  the  DSPC  model. 

Table  10 

MCSP  AND  COST  RESULTS 


VERTEX 

POINT 

COMBINATION  OF  OPTIONS 

UNIT 

COST 

(Thousands) 

SUBSYSTEM 

1 

SUBSYSTEM 

2 

SUBSYSTEM 

3 

MCSP 

0 (Baseline) 

0 

0 

0 

.6976 

77.1 

1 

1 

0 

0 

.7135 

72.0 

2 

1 

1 

0 

.7501 

73.0 

3 

1 

1 

1 

.8019 

74.5 

4 

1 

2 

1 

.8263 

75.7 

5 

1 

2 

2 

.8779 

85.3 

6 

2 

2 

2 

.8934 

89.8 

The  DSPC  curve  is  shown  in  Figure  9 which  shows  that  only  6 of  the  27 
possible  configurations  are  optimal.  For  this  simple  example,  the  remaining  21 
nonoptimal  values  were  calculated  and  are  shown  in  the  figure. 

2.  Redundancy  Options.  Redundancy  is  perhaps  the  most  straightforward  reli- 
ability improvement  technique  to  consider  for  a subsystem  option  when  volume, 
weight,  and  other  constraints  are  met.  Furthermore,  the  probability  of  success 
is  easily  calculated  according  to  well-defined  rules,  and  the  cost  is  a simple 
sum  of  the  costs  of  the  individual  elements.  However,  even  when  volume  and 
weight  constraints  allow  redundancy  of  certain  subsystems,  these  options  are  not 
necessarily  optimal  as  the  following  example  will  show.  The  DSPC  procedure  will 
bo  applied  to  a hypothetical  example  in  which  one  subsystem  can  be  made  redundant. 
Implementation  of  the  DSPC  model  will  then  determine  whether  the  redundancy 
option  should  be  selected,  and,  if  so,  at  what  vertex  point  on  the  DSPC  curve. 
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Figure  9.  OSPC  Example. 
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Consider  a system  consisting  of  three  essential  subsystems,  with  the  per- 
formance and  unit  cost  ($  in  thousands)  values  of  the  options  listed  in  Table  11. 


Table  11 

SUBSYSTEM  COST  AND  PERFORMANCE  VALUES 


| SUBSYSTEM 
' NUMBER  i 

I 

j 

1 

BASELINE 

OPTION  1 

OPTION  2 

|p(0) 

I 1 

c(°) 

Li 

p(l) 

Ki 

C(D 

p(2) 

*1 

c(2) 

L1 

< 

.88 

35 

.92 

39 

.98 

56 

2 

I 

.85 

30 

.90 

35 

.97 

41 

3 

.76 

20 

— 

— 

— 

— 

Suppose  space,  weight,  and  other  constraints  allow  subsystem  3 to  be  redundant 
(operative  redundancy).  This  then  represents  an  option  for  subsystem  3 where 
and  C^  are  calculated  as  follows: 


(IV-37a)  / 

V 


C3^  " 2 C30)  = 540 


(IV -37b ) 


Inserting  the  values  (IV-37a)  and  (IV-37b)  into  Table  11  for  the  redundancy  Option 
1 for  subsystem  3,  yields  Table  12.  The  ordering  of  the  options  by  increasing 
performance  (Expression  ( I V-3) ) has  already  been  performed. 


Table  12 

SUBSYSTEM  VALUES  WITH  REDUNDANCY  OPTION 


SUBSYSTEM 
NUMBER  i 

baseline 

OPTION  1 

OPTO 

DN  2 

Pw> 

K1 

r(0) 

Li 

P0) 

1 

r(D 

Li 

p(2) 

~J2T 

Li 

1 

.88 

35 

.92 

39 

.98 

56 

2 

.85 

30 

.90 

35 

.97 

41 

3 

.76 

20 

.94 

40 

— - 

— 
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From  the  set  (IV-39),  the  next  optimal  option  for  subsystem  1 is  Option  1,  for 
subsystem  2 Option  1 Is  rejected  since  Option  2 has  a higher  weight,  and  for  sub- 
system 3 the  only  option  is  the  redundancy  Option  1.  Therefore,  taking  the  maxi- 
mum value  of  for  subsystems  1 * 1,  2,  3 yields  the  set: 


- 1 

J X1 (2) 

X11 

= 1.0112, 

. I 

% 

3 »2<2) 

CVI 

CM 

*< 

II 

= 1.0121, 

* [ 

] »,<2> 

= X31 

« 1.0107 

( IV-40) 

Since  the  maximum  of  the  set  of  weights  (IV-40)  is  A2(2)  = A22,  the  next  optimal 
option  is  Option  2 for  subsystem  2.  Therefore,  for  the  second  vertex  point,  the 
baseline  subsystem  2 should  be  replaced  by  Option  2.  The  system  configuration 
for  the  second  vertex  point  is 

Baseline  for  subsystem  1, 

Option  2 for  subsystem  2, 

Baseline  for  subsystem  3 

The  corresponding  MCSP  and  cost  of  the  second  vertex  point  are 

>(p)  ■ -57U)  ’ •« 


c2 


= P 


cl 


.65 


(IV-41a) 


and 


«,  * (421  - 4°j 


85  + (41  - 30)  = $96 


( I V-41 b) 


Since  no  additional  options  remain  for  subsystem  2,  A2(3)  = 0 while  A^(3)  = A^(2) 
and  *3(3)  s A3(2).  Thus,  the  new  set  of  A values  is 
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k / rv  v ' y 


1 

r 


*3(3)  * X31  « 1.0107  . (IV-42) 

From  (IV-42),  it  follows* that  Option  1 for  subsystem  1 should  be  selected,  and 
the  system  configuration  for  the  third  vertex  point  consists  of 

Option  1 for  subsystem  1 , 

Option  2 for  subsystem  2, 

Baseline  for  subsystem  3 

The  corresponding  MCSP  and  cost  of  the  third  vertex  point  are 


(IV-43a) 


C3  s c2  +(C21)  - c20))  “ 96  + (39  - 35)  = $100  . (IV-43b) 

To  determine  the  fourth  vertex  point  set  m * 3 and  s(3)  = 1 since  subsys- 
tem 1 was  changed  in  determining  the  third  vertex  point.  In  addition,  £(1,  3)  = 1 
since  Option  1 was  selected  for  subsystem  1.  The  new  weighting  factor  for  sub- 
system 1 is  then  (since  only  Option  2 remains  for  subsystem  1) 


x,(4) 


*12 


>!2)\4 

w ) 


1 .0037 


(IV-44) 


Therefore,  the  new  set  of  weights  required  to  determine  the  fourth  vertex  point 
is 


I 


L 
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(IV-45) 


*j(4)  • A12  « 1.0037, 

*2(4)  * 0, 

*3(4)  - X31  = 1.0107  . 


The  maximum  of  the  values  (IV-45)  is  *31  which  means  that  Option  1 (redundancy 
option)  for  subsystem  3 should  now  be  selected.  The  system  configuration  for  the 
fourth  vertex  point  is  therefore 


Option  1 for  subsystem  1 ,• 
Option  2 for  subsystem  2 , 
Option  1 for  subsystem  3 


The  MCSP  and  cost  for  the  fourth  vertex  point  are 


(IV-46a) 


(IV-4Sb) 


Since  no  additional  options  exist  for  subsystem  3,  a3(5)  = 0.  The  new  set  of 
weights  becomes 


A,(5)  - X12  = 1.0037, 

A2(5)  = 0, 

*3(5)  = 0 . ( IV-47) 
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From  (IV-47),  it  follows  that  the  only  remaining  option  is  Option  2 for  subsystem 
1,  and  the  system  configuration  for  the  fifth  and  last  vertex  point  consists  of 

Option  2 for  subsystem  1 , 

Option  2 for  subsystem  2, 

Option  1 for  subsystem  3 


The  MCSP  and  cost  of  the  fifth  vertex  point  are 


P 


c5 


120  +(17)  = $137 


(IV-48a) 


(IV-48b) 


Table  13  lists  the  configurations  together  with  the  corresponding  values  of  MCSP 

I 

and  cost.  Observe  that  the  redundancy  option  was  not  selected  until  the  fourth 
vertex  point.  This  points  out  the  fact  that  even  if  subsystem  redundancy  is 
possible,  it  does  not  necessarily  mean  that  it  should  be  selected.  It  is  depen- 
dent upon  performance  and  cost. 


Table  13 

MCSP  AMD  COST  RESULTS  FOR  REDUNDANCY  EXAMPLE 


VERTEX 

POINT 

COM3 1 MAT I ON  OF  OPTIONS 

MCSP 

1 

UNIT 

COST 

(Thousands) 

SUBSYSTEM 

1 

SUBSYSTEM 

2 

SUBSYSTEM 

3 

1 

0 

0 

0 

LP 

85 

2 

0 

2 

0 

.65 

96 

3 

1 

2 

0 

OY 

00 

100 

4 

1 

2 

1 

.84 

120 

5 

2 

2 

1 

.89 

137 

— 


/ 
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3.  Target  Activated  Munitions.  In  Section  III-E-1,  a hypothetical  mine  ex- 
ample was  Introduced,  and  Its  Baseline  System  Is  defined  In  Table  1 on  page  33. 
The  MCSP  of  this  Baseline  System  was  calculated  to  be  .25.  Suppose  that  options 
become  available  for  5 of  the  mine  subsystems  with  no  options  for  the  remaining 
subsystems.  These  options  are  defined  In  Table  14,  where  the  ordering  of  the  op- 
tions (Expression  IV-3)  has  already  been  performed.  It  is  assumed  that  the  unit 
cost  of  the  Baseline  System  is  $200.00.  Therefore,  for  the  Baseline  System 


co 


.25 


(IV-49a) 


and 


Crt  = $200.00 


( IV-49b) 


Table  14 

SUBSYSTEM  OPTIONS  FOR  MINE 


1 „ i 

BASELINE 

OPTION  1 

OPTION  2 

OPTION  3 

SUBSYSTEM 

p(o) 

|c{»> 
1 1 

p(D 

c<i> 

Li 

p(2) 

c(2) 

Li 

p(3) 

c(3) 

1.  Fin 

.70 

1.00 

.75 

1.50 

.85 

1.75 

.99 

2.75 

2.  Brake 

.75 

2.50 

.85 

3.00 

.97 

4.50 

— 

— 

3.  Cutter 

.80 

3.00 

.90 

2.50 

.98 

5.00 

— 

— 

4.  Body 

.88 

5.00 

.95 

7.00 

.99 

9.00 

— 

— 

5.  Safe  & Arm  ; 

.90 

4.00 

.97 

5.50 

.99 

7.50 

— 

— 

By  inspection  of  Table  14,  it  is  clear  that  the  Baseline  System  can  be  adjusted  by 
replacing  the  Cutter  (subsystem  3)  by  Option  1,  since  this  option  has  higher  per- 
formance at  lower  cost.  Therefore,  since  no  other  adjustments  are  possible,  the 
Adjusted  Baseline  System  (the  first  optimal  vertex  point)  consists  of 
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Baseline  for  subsystem  1, 
Baseline  for  subsystem  2, 
Option  1 for  subsystem  3, 
Baseline  for  subsystem  4, 
Baseline  for  subsystem  5 


The  MCSP  and  cost  of  the  Adjusted  Baseline  System  are 


P 


cl 


P. 


co 


(5p)  ■ -25N 


.28 


( IV-50a) 


and 


- 200  + (2.50  - 3.00)  = $199.50  . (IV-50b) 


The  DSPC  model  can  now  be  applied  to  determine,  step-by-step,  the  remaining  opti- 
mal vertex  points.  To  determine  the  second  vertex  point,  the  set  of  weighting 
factors  A.,  defined  by  Equations  (IV-12)  must  be  calculated  for  the  remaining  op- 
tions of  each  subsystem  (i  = 1 , 2,  3,  4,  5) . This  is  the  most  time  consuming 
step.  Since  for  the  Adjusted  Baseline  System  Option  1 was  selected  for  subsystem 
3,  k(3)  = 1 whereas  k(l)  = k(2)  s k(4)  = k(5)  = 0.  Application  of  Equation  (IV-12) 
yields  for  subsystem  1 the  following  set  of  weights  in  going  from  its  present 
baseline  value  to  each  of  the  remaining  options: 


Therefore,  since  the  maximum  of  the  set  is  tk®  next  optimal  option  for  sub- 
system 1 is  Option  2 with  weight 


1.1480  , X12 


1.2955 


.99)05 

.70/ 


1 .2190 


(IV-51) 


A1 (2)  = A1?  = 1.2955 


(IV-52) 
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which  means  that  Option  1 was  rejected.  For  subsystem  2,  the  option  weights  are 


'21 


1 

T5ff 


1.2844 


22 


1 

Oo 


1.1372 


( IV-53) 


Therefore,  the  next  optimal  option  for  subsystem  2 is  Option  1 with  weight 


X2(2)  « X21  = 1.2844 


(IV-54) 


For  subsystem  3,  k(3)  = 1 which  means  that  the  only  remaining  weight  is 


1 

2.50 

- 1-0346  . ( IV-55) 


Therefore, 


x3(2)  = x32  = 1.0346 


( I V— 56) 


For  subsystem  4,  the  option  weights  are 


f.  95 


1 

1 2 . 00 


41  " ITSSj 

Therefore, 

x4(2)  * X41  = 1.0390 

For  subsystem  5,  the  option  weights  are 


* 1.0299  . (IV-57) 


J 97  P*'*®  I 99 

xsi  = ra-l  = • x - 1 


i 

13.50 


(IV-58) 


52  = [TSOI  * 1*0276  . (IV-59) 
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Therefore 


*5^2)  * *51  * 1.0512  . (IV-60) 

The  values  (IV-52),  (IV-54),  (IV-56),  (IV-58),  and  (IV-60)  required  to  determine 
the  second  vertex  point  are 


^(2) 

11 

CVJ 

*< 

II 

1.2955 

X2(2) 

= - 

1.2844 

a3(2) 

‘ *32  •’ 

1.0346 

*4(2) 

‘ *41  ‘ 

1.0390, 

X5{2) 

‘ *51  - 

1.0512 

The  maximum  of  the  set  (IV-61)  is  therefore,  the  baseline  subsystem  1 should 
be  replaced  by  Option  2.  Therefore,  the  second  vertex  point  is  defined  by  the 
system  configuration 

Option  2 for  subsystem  1, 

Baseline  for  subsystem  2, 

Option  1 for  subsystem  3, 

Baseline  for  subsystem  4, 

Baseline  for  subsystem  5 


The  MCSP  and  cost  of  the  second  vertex  point  are 


(IV-62a) 
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L 


I. 


and 


C1  + 


(cP>  - C<0») 


199.50  + (1.75  - 1.00)  = $200.25  . (IV-62b) 


To  calculate  the  third  vertex  point  m = 2,  and  since  Option  2 was  selected  for 
subsystem  1 for  the  second  vertex  point  s(2)  = 1 and  t(2,  2)  * 1.  Only  one  more 
option  remains  for  subsystem  1,  and  therefore 


1 


X. ( 3)  = X 


13 


■ W = M ' 


00 


= 1.1647 


( IV-63) 


and  i(l,  3)  = 3.  The  corresponding  weighting  factors  for  the  other  subsystems  re- 
main unchanged  (IV-61).  Therefore,  for  determining  the  third  vertex  point  the  re- 
quired set  of  weighting  factors  is 


x^) 

= "13  = 

1.1647, 

x2(3) 

II 

CVJ 

*< 

II 

1.2844, 

X3(3) 

X32  = 

1 .0346, 

X4(3) 

II 

r< 

II 

1.0390, 

a5(3) 

X51  = 

1.0512 

( IV-64) 


The  maximum  of  the  set  (IV-64)  is  which  means  that  Option  1 for  subsystem  2 is 
selected,  and  the  system  configuration  for  the  third  vertex  point  is 
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Option  2 for  subsystem  1 > 
Option  1 for  subsystem  2, 
Option  1 for  subsystem  3, 
Baseline  for  subsystem  4, 
Baseline  for  subsystem  5 


u 

u 

u 


) . 


IJ 


The  MCSP  and  cost  of  the  third  vertex  point  are 


The  new  weight  for  subsystem  2 for  determining  the  fourth  vertex  point  is 


H 


^(4)  = *22 


( IV-66) 


The  values  ^(4),  a3(4),  a4(4),  a5(4)  are  the  same  as  the  corresponding  values  of 
the  set  (IV-64). 


The  process  for  determining  the  remaining  vertex  points  is  repeated  step- 
by-step,  and  the  results  of  the  calculations  are  listed  in  Table  15  where  the 
system  configuration  for  each  vertex  point  is  identified.  The  DSPC  curve  is  dis- 
played in  Figure  10. 
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Table  15 


OPTIMAL  CONFIGURATIONS  FOR  MINE  EXAMPLE 


VERTEX 

POINT 

MINE  CONFIGURATION  (COMB.  OF  OPTIONS) 

MCSP 

UNIT 

COST 

($) 

FIN 

BRAKE 

CUTTER 

BODY 

SAFE  & ARM 

1 

0 

0 

1 

0 

0 

.28 

199.50 

2 

2 

0 

1 

0 

0 

.34 

200.25 

3 

2 

1 

1 

0 

0 

.39 

200.75 

4 

3 

1 

1 

0 

0 

.45 

201 .75 

5 

3 

2 

1 

0 

0 

.52 

203.25 

6 

3 

2 

1 

O 

1 

.56 

204.75 

7 

3 

2 

1 

1 

1 

.60 

206.75 

8 

3 

2 

2 

1 

1 

.66 

209.25 

9 

3 

2 

2 

2 

1 

.68 

211.25 

10 

3 

i 

2 

2 

2 

2 

.70 

213.25 

The  subsystem  options  defined  in  Table  14  lead  to  324  possible  mine  con- 
figurations, each  with  a certain  MCSP  and  cost.  Application  of  the  DSPC  algorithm 
determined  that  only  10  configurations  are  optimal.  The  remaining  314  configura- 
tions are  nonoptimal  and  result  in  points  below  the  OSPC  curve. 

A significant  comment  can  be  made  on  another  aspect  of  the  results  shown 
in  Table  15.  Suppose,  for  example,  that  the  Program  Manager  is  required  to  pur- 
chase 100,000  mines  at  a unit  cost  of  $200.00.  This  means  that  the  total  program 
cost  is  S20M.  Since  the  number  of  mines  and  unit  cost  are  specified,  the  Program 
Manager  has  essentially  no  flexibility  in  managing  his  program  since  only  the  first 
vertex  point  has  a unit  cost  not  exceeding  $200.00.  If,  however,  the  only  restric- 
tion on  the  Program  Manager  is  to  a fixed  program  cost  of  $20M,  then  the  results 
of  Table  15  can  be  utilized  to  negotiate  with  higher  level  decision  makers  to 

decide  if  it  is  more  cost  effective  to  invest  more- dollars  early  in  the  pro- 
gram to  produce  fewer  but  better  mines  at  a higher  unit  cost.  Suppose  the  pro- 
gram cost  is  S20M.  The  results  shown  in  Table  15  can  be  translated  into  those 
of  Table  16. 


Table  16 


DSPC  RESULTS  FOR  A FIXED  PROGRAM  COST 


] 

VERTEX 

POINT 

— 

MCSP 

j 

UNIT 

COST 

($) 

1 

NUMBERS 

PURCHASED 

NUMBER  OF 
OPERATIVE 
MINES 
EXPECTED 

INCREASE 

OVER 

BASELINE 

Baseline 

.25 

200.00 

100,000 

25,000 

0 

1 

.28 

199.50 

100,250 

28,070 

3,070 

2 

.34 

200.25 

99,875 

33,958 

8,958 

3 

.39 

200.75 

99,626 

38,854 

13,854 

4 

.45 

201 .75 

99,132 

44,610 

19,610 

5 

.52 

203.25 

98,401 

51,169 

26,169 

6 

.56 

204.75 

97 ,680 

54,701 

29,701 

’ 7 I 

18 

.60 

206.75 

96,735 

58,041 

33,041 

.66 

209.25 

95,579 

63,082 

38,082 

9 

1 J 

; 10 

t_ 

.68 

211.25 

94,675 

64,379 

39,379 

.70  ! 

L 

213.25 

93,787 

65,651 

40,651 

Table  16  shows  that  by  purchasing  fewer  mines  to  maintain  the  $20M  fixed 
budget,  the  number  of  expected  operative  mines  increases  significantly  over  the 
Baseline  and  Adjusted  Baseline  System  values.  The  purchase  of  fewer  mines  may 
also  result  in  savings  due  to  less  storage,  delivery  costs,  etc.  This  example 
clearly  illustrates  the  types  of  decision-making  information  that  can  be 
generated  by  the  DSPC  methodology. 

In  Section  V-C,  this  mine  example  will  be  continued  and  extended  to  include 
system  effectiveness  when  warhead  options  are  considered. 

F.  THE  RIGID  "DESIGN  TO  UNIT  COST"  PROBLEM 

To  this  point  the  handbook  has  presented  techniques  which  the  Program 
Manager  could  use  to  optimize  system  performance  at  various  levels  of  cost.  In 
the  examples  presented  previously,  subsystem  options  were  obtained  for  the  most 
critical  subsystems,  and  the  DSPC  procedure  was  applied  to  determine  optimal 
system  configurations  at  different  levels  of  cost.  This  led  to  increased  system 
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performance  at  increased  cost.  However,  the  chief  concern  within  the  military 
community  is  the  unit  cost  limit  imposed  on  a given  weapon  system;  and  until 
total  production  numbers,  operational  deployment  tactics  and  some  measure  of 
effectiveness  are  defined  the  main  concern  is  cost.  The  overwhelming  reaction 
of  project  engineers  has  been  that  tradeoff  techniques  are  invaluable  ir.  re- 
orienting cost  goals;  but,  until  changed,  the  unit  cost  is  the  governing  factor 
in  day-to-day  system  development. 

In  the  introduction  to  this  handbook,  it  was  stated  that  the  Program  Manager 
should  have  a means  to  "identify  subsystems  whose  performance  levels  are  more 
than  adequate  to  meet  mission  requirements  and  investigate  if  these  subsystems 
can  be  replaced  by  lower  cost  subsystems  (which  generally  implies  lower  perform- 
ance) with  the  cost  savings  invested  more  effectively  in  the  improvement  of  other 
more  critical  subsystems  ...."  The  procedure  for  accomplishing  this  can  best  be 
described  by  extending  the  mine  example  discussed  previously.  The  same  procedure 
is  applicable  to  any  other  system,  and  in  many  cases  will  lead  to  a high  payoff 
in  reducing  system  cost.  In  fact,  this  approach  (resource  allocation)  might  be 
the  only  way  to  meet  mission  requirements  while  staying  within  the  constraints 
of  DTC  goals. 

In  the  mine  example,  the  MCSP  model  was  applied  first  to  determine  the 
Baseline  MCSP  and  also  to  provide  the  ranking  of  the  subsystems  in  terms  of  their 
likelihood  of  experiencing  a critical  failure.  The  subsystem  criticality  ranking 
is  presented  in  Table  2,  page  34.  The  top  five  critical  subsystems  listed  in 
Table  2 were  then  selected  for  reliability  improvement  considerations  which  led 
to  the  improved  performance  options  listed  in  Table  14,  page  79.  Application  of 
the  DSPC  methodology  to  these  options  for  the  top  five  critical  subsystems  then 
led  to  the  optimal  DSPC  curve  displayed  in  Figure  10,  page  85. 

It  appears  natural  to  seek  improved  reliability  options  for  the  more 
critical  subsystems  (at  the  top  of  the  list  in  Table  2),  since  the  emphasis  is 
invariably  on  system  improvement.  However,  the  subsystems  at  the  bottom  of  the 
list  also  should  be  investigated  to  determine  if  cheaper  (which  generally  entails 
lower  performance)  options  are  available.  This  seems  paradoxical  to  seek  lower 
performance  subsystems  options  at  a lower  cost.  However,  cost  is  an  extremely 
important  factor  in  system  development,  and  the  cost  savings  for  less  critical 
subsystems  at  the  bottom  of  the  list  may  be  more  effectively  invested  In 
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improving  the  more  critical  subsystems  at  the  top  of  the  list.  This  often  can 
lead  to  high  payoffs.  Of  course,  there  may  be  certain  subsystems  which  require 
high  performance,  more  expensive  options  for  some  reasons  such  as  safety  or 
logistics  considerations;  and  consequently,  lower  performance  is  not  acceptable 
for  such  subsystems. 

Suppose  a cheaper,  lower  performance  option  is  obtained  for  five  of  the 
less  critical  mine  subsystems  at  the  lower  part  of  the  list  in  Table  2.  These 
cheaper  options  and  the  original  baseline  values  are  identified  in  Table  17. 

Table  17 

IDENTIFICATION  OF  CHEAPER,  LOWER  PERFORMANCE  OPTIONS 


ORIGINAL  BASELINE 

CHEAPER  OPTION 

SUBSYSTEM 

MTBF 

(Hrs) 

PERFORMANCE 

UNIT 

COST 

MTBF 
_ (Hrs) 

PERFORMANCE 

UNIT 

COST 

Battery 

2,500 

.91 

2.00 

1,500 

.85 

1.25 

Processor 

2,500 

.91 

2.00 

1 ,500 

.85 

1.25 

Sensor  A 

5,000 

.98 

4.50 

3,000 

.96 

1.50 

Sensor  B 

3,000 

.96 

4.00 

2,000 

.94 

2.00 

Structure  & Harness 

35,000 

.99 

2.50 

10,000 

.98 

1.00 

The  first  step  is  to  reestablish  the  Baseline  System  using  the  cheaper 
options  identified  in  Table  17,  and  consider  the  original  baseline  subsystems 
as  reliability  improvement  options.  Combining  these  options  with  those  already 
established  for  the  more  critical  subsystems  (Table  14,  page  79)  leads  to  the 
new  set  of  subsystem  options  identified  in  Table  18.  This  new  set  of  options 
leads  to  10,368  possible  mine  configurations!  Clearly,  it  would  be  a formidable 
task  to  investigate  every  configuration.  This  shows  the  necessity  of  the  single 
DSPC  optimization  algorithm. 
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Table  18 

NEW  BASELINE  SYSTEM  AND  SET  OF  SUBSYSTEM  OPTIONS  FOR  MINE 


BASELINE 

OPTION  1 

OPTION  2 

OPTION  3 

SUBSYSTEM 

p(0) 

c(°) 

ci 

p(l) 

*i 

r(1) 

Li 

p(2) 

c(2) 

p(3) 

K1 

c( 3) 

1.  Fin 

.70 

1.00 

.75 

1.50 

.85 

1.75 

.99 

2.75 

2.  Brake 

.75 

2.50 

.85 

3.00 

.97 

4.50 

— 

3.  Cutter 

.80 

3.00 

.90 

2.50 

.98 

5.00 

— 

4.  Body 

.88 

5.00 

.95 

7.00 

.99 

9.00 

— 

— 

5.  Safe  & Arm 

.90 

4.00 

.97 

5.50 

.99 

7.50 

— 

6.  Battery 

.85 

1.25 

.91 

2.00 

— 

— 

— 

— 

7.  Processor 

.85 

1.25 

.91 

2.00 

— 

— 

— 

— 

8.  Sensor  A 

.96 

1.50 

.98 

4.50 

— 

— 

— 

9.  Sensor  B 

.94 

2.00 

.96 

4.00 

— 

— 

— 

- — 

10.  Structure 
S Harness 

.98 

1.00 

.99 

2.50 

— 

— 

— 

— 

Since  subsystems  6,  7,  8,  9,  and  10  have  new  baseline  values*  the  MCSP  and 
cost  of  the  new  Baseline  System  becomes  (using  equations  similar  to  (IV-7)  and 
( I V-8) ) 

Po  - • •" 

Co  * 200  - (.75  + .75  + 3.00  + 2.00  + 1.50)  = $192.00  . 

Application  of  the  DSPC  methodology  to  the  options  in  Table  13  leads  to  15 
optimal  system  configurations.  There  are  10,353  nonoptimal  configurations!  The 
optimal  configurations  are  identified  in  Table  19.  Examination  of  the  system 
configurations  for  the  first  four  vertex  points  in  Table  19,  shows  that  the  money 
saved  by  substituting  the  cheaper,  lower  performance  options  may  be  allocated  to 
improve  the  more  critical  subsystems.  Furthermore,  Option  1 (original  baseline) 
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(IV-67b) 


— 


\ 

r 


N 


/ 


/ 


c 

e 

e 

E 

E 

E 

E 


E 


E 

E 


E 


E 

E 


for  the  Battery  and  Processor  was  not  selected  until  the  fifth  and  sixth  vertex 
points,  respectively,  at  a system  unit  cost  below  the  $200  for  the  original 
Baseline  System. 


Table  19 

OPTIMAL  CONFIGURATIONS  FOR  NINE  EXAMPLE  WEN  RESOURCES  ARE  ALLOCATED  OPTIMALLT 


M I 

NE  CONFIGURATION  (COMBINATION  OF  OPTIONS) 

VERTEX 

POINT 

FIN 

BRAKE 

CUTTER 

BOOT 

SAFE 

& 

BATTERY 

PROCESSOR 

SENSOR 

A 

SENSOR 

B 

STRUCTURE 

1 

MCSP 

UNIT 

COST 

(S) 

ARM 

A 

HARNESS 

1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

.24 

191.50 

2 

2 

0 

1 

0 

0 

0 

0 

0 

0 

0 

.29 

192.25 

3 

2 

1 

1 

0 

0 

0 

0 

0 

0 

0 

.33 

192.75 

4 

3 

1 

1 

0 

0 

0 

0 

0 

0 

0 

.38 

193.75 

5 

3 

1 

1 

0 

0 

1 

0 

0 

0 

0 

.41 

194.50 

6 

3 

1 

1 

0 

0 

1 

1 

0 

0 

0 

.43 

195.25 

7 

3 

2 

1 

0 

0 

1 

1 

0 

0 

0 

.50 

196.75 

8 

3 

2 

1 

0 

1 

1 

1 

0 

0 

0 

.53 

198.25 

9 

3 

2 

1 

1 

1 

1 

1 

0 

0 

0 

.S8 

200.25 

10 

3 

2 

2 

1 

1 

1 

1 

0 

0 

0 

.63 

202.75 

11 

3 

2 

2 

2 

1 

1 

1 

0 

0 

0 

.65 

204.75 

12 

3 

2 

2 

2 

1 

1 

1 

0 

1 

0 

.67 

208.75 

13 

3 

2 

2 

2 

2 

1 

1 

0 

1 

0 

.68 

208.75 

14 

3 

2 

2 

2 

2 

1 

1 

1 

1 

0 

.69 

211.75 

15 

3 

2 

2 

2 

2 

1 

1 

1 

1 

1 

.70 

213.25 

The  DSPC  curve  for  this  example  is  displayed  in  Figure  11.  For  comparison 
purposes,  the  DSPC  curve  for  the  previous  case  (Figure  10;  where  only  perform- 
ance improvement  options  for  top  five  critical  subsystems  were  considered  is 
shown  as  a dashed  curve  in  Figure  11.  Observe  that  at  a unit  cost  of  $200,  the 
optimal  allocation  of  resources  yields  an  MCSP  about  68%  higher.  Conversely, 
the  achievement  of  a prescribed  MCSP  is  obtainable  at  a lower  cost. 


Obtaining  cheaper  options  for  the  less  critical  subsystems  (and  having 
options  for  the  more  critical  subsystems)  almost  always  leads  to  better  results. 
If  the  original  Baseline  System  is  optimal,  then  the  DSPC  methodology  will  first 
select  those  cheaper  options.  This  means  that  the  Optimal  Allocation  curve  will 
meet  the  original  DSPC  curve  at  the  original  baseline  vertex  point  and  then 
coincide  with  the  original  DSPC  curve.  Whenever  the  original  Baseline  System  is 
nonoptimal  the  procedure  will  always  lead  to  better  results. 
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This  section  has  presented  a general  description  of  the  DSFC  methodology 
together  with  examples  to  illustrate  the  simplicity  of  its  application.  The 
OSPC  methodology,  applied  to  a system  under  development,  can  be  exercised  con- 
tinuously by  a program  engineer  throughout  the  program  to  determine  optimal 
system  configurations  at  various  cost  levels.  This  provides  the  Program  Manager 
with  a tool  for  making  day-by-day  decisions  and  assessment  of  system  progress 
based  upon  the  best  information  available.  It  also  provides  valuable  guidance 
to  the  Program  Manager  in  meeting  system  DTC  goals  as  well  as  a means  for 
negotiating  with  higher  decision  makers  in  reestablishing  performance  or  cost 
goals. 


The  next  section  extends  this  methodology  to  include  a procedure  for 
selecting  the  combination  of  subsystem  options  yielding  the  maximum  system 
•effectiveness  at  any  prescribed  cost. 
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SECTION  V 


DESIGNING  TO  SYSTEM  PERFORMANCE/COST/EFFECTIVENESS  METHODOLOGY 
A.  GENERAL 


One  very  challenging  task  of  the  analyst  is  to  develop  an  appropriate 
measure  of  effectiveness  for  a system  which  realistically  and  quantitatively 
measures  the  extent  to  which  the  system  satisfies  its  specified  objectives. 

Perhaps  even  more  challenging  is  the  development  of  a simplified  measure  of 
effectiveness  which  Is  meaningful  and  of  value  to  both  the  analyst  and  the  pro- 
ject engineer.  A complex  measure  of  system  effectiveness  (e.g.,  one  requiring 
a large  simulation  model)  may  be  important  to  the  higher  Oecision  Maker  in 
determining  if  the  system  is  sufficiently  cost  effective  to  warrant  further 
development.  However,  the  Program  Manager  is  interested  in  developing  the  best 
system  possible  under  given  cost  constraints,  and  a more  simplified  measure  Is 
usually  desired  which  can  be  used  on  a day-by-day  basis  in  the  development  of 
his  system.  Unfortunately,  the  effectiveness  analyses  of  a developing  system  is 
usually  accomplished  outside  the  program  office  resulting  in  time  delays  and 
leaving  the  project  engineer  with  little  except  intuition  '*»•  past  experience  to 
weigh  potential  effect !veness  improvement  options.  The  a'llyst  can  provide  an 
invaluable  service  by  devising  a measure  of  effectiveness  which  the  program 
office  can  utilize  on  a continuous  basis  in  the  application  of  the  DSPCE  metho- 
dology. A few  examples  of  measures  of  effectiveness  of  various  systems  arp: 
sorties  on  target,  targets  destroyed,  and  carqo  delivered  Numerous  other 
examples  could  be  cited.  It  is  the  intent  of  this  section  to  show  how  a project 
engineer  can  optimize  the  effectiveness  of  his  system  once  the  analyst  has 
determined  an  aporopriate  measure  of  effectiveness  for  use  by  the  program  office. 
In  this  section,  it  is  assumed  that  the  analyst  has  provided  the  project  enqincer 
with  an  appropriate  measure  of  effectiveness  for  V . system.  When  such  a measure 
has  been  established  and  subsystem  options  directly  affecting  this  measure  of 
effectiveness  become  available,  the  Designing  to  System  Performance/Cost/Effect^'e 
ness  (DSPCE)  methodology  can  be  Implemented.  This  methodology  determines  the 
combination  of  subsystem  options  (both  reliability  and  effectiveness  option?) 
yielding  the  maximum  system  effectiveness  at  any  prescribed  cost.  In  this  section 
the  DSPCE  methodology  is  described,  and  the  target  activated  munitions  examole 
considered  in  the  previous  sections  is  extended  to  illustrate  the  application  of 
the  methodology  when  effectiveness  options  are  available. 
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B.  IMPLEMENTATION  OF  THE  DSPCE  METHODOLOGY 


1 . No  Effectiveness  Options.  For  many  systems , there  are  subsystem  re- 
liability options  which  affect  the  MCSP,  but  no  subsystem  options  directly  re- 
lated to  effectiveness.  Certainly,  the  MCSP  of  the  system  plays  an  important 
role  in  the  effectiveness  of  the  system.  Furthermore,  Improvements  In  MCSP 
result  in  quantifiable  improvements  in  effectiveness.  If,  for  example,  certain 
avionics  subsystems  of  an  aircraft  or  the  warhead  of  a weapon  have  been  pre- 
viously specified,  the  Program  Manaqer  has  no  freedom  to  change  these  subsystems 
(other  than  reliability  improvement).  In  such  a case,  only  the  DSPC  model  Is 
applicable;  however,  the  resulting  MCSP  Improvements  are  translatable  into 
effectiveness  improvements.  Thus,  the  DSPC  curve  such  as  that  illustrated  in 
Figure  2 on  page  151s  directly,  transformed  into  an  optimal  effectiveness 
curve  with  effectiveness  improvements  resulting  sol  el y from  optimal  subsystem 
reliability  improvement  options. 


2.  Effectiveness  Options.  When  options  exist  for  certain  subsystems  which 
have  a direct  influence  (other  than  in  the  MCSP  sense)  on  system  effectiveness, 
then  the  DSPCE  methodology  is  applicable.  The  general  procedure  for  implement- 
ing the  DSPCE  methodology  is  described  below  and  will  be  applied  to  a specific 
example  in  Section  V-C. 


Consider  a hypothetical  system  for  which  only  one  subsystem  directly 
affects  t'«e  measure  of  effectiveness.  Assume  there  are  three  options  for  this 
subsystem,  each  of  which  influences  the  system  effectiveness  to  a different  degree. 
Combined  with  the  other  subsystems,  these  can  be  considered  as  three  separate 
systems  denoted  by  S1 , S2,  S-j.  Suppose  the  three  systems  are  characterized  as 
follows: 


a.  System  Sj  is  relatively  simple  and  low  cost  with  effectiveness  E^ 
provided  S1  does  not  experience  a critical  failure,  i.e.,  maximum  effectiveness 


b.  System  S2  is  more  complex  and  expensive  than  Sj  but  with  E2  > Ej 
(providing  S2  does  not  experience  a critical  failure). 
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c.  System  S3  Is  of  high  complexity  and  the  most  expensive  option; 
however,  its  effectiveness  E3  Is  the  highest  (provided  S3  does  not  experience  a 
critical  failure).  - 

The  procedure  for  implementing  the  DSPCE  methodology  Is  to  consider  the 
systems  separately  and  first  apply  the  DSPC  model  to  each  system.  In  Figure  12a. 
typical  DSPC  results  are  shown  for  the  three  systems.  Comparison  of  the  first 
vertex  point  for  each  system  shows  that,  proceeding  from  System  S1  to  System  S3, 
the  cost  becomes  higher  and  the  MCSP  becomes  lower  (because  of  Increasing  com- 
plexity). However,  when  the  DSPC  results  for  each  system  are  transformed  into 
effectiveness  versus  cost  curves,  results  such  as  those  shown  in  Figure  12b  could 
be  obtained.  These  results  show  that  for  cost  between  CQ  and  C^  subsystem  reli- 
ability options  should  be  selected  from  System  , i.e.,  one  of  the  first  4 vertex 
points  of  S|.  For  cost  between  and  C^,  there  are  two  optimal  configurations 
for  System  S2«  For  cost  greater  than  Cg,  System  S3  should  be  selected.  The  op- 
timal effectiveness  versus  cost  curve  is  depicted  by  the  vertex  points  on  the 
solid  curve  in  Figure  12b.  The  dashed  sections  of  the  curves  are  nonoptimal  but 
shew  the  effectiveness  if  the  Program  Manager  were  restricted  to  use  only  one  of 
the  Systems  Sj,  S£.  or  S3. 

The  information  displayed  in  Figure  12b  shows  the  decision-maker  which 
system  (and  combination  of  subsystem  options  for  that  system)  provides  the  maxi- 
mum effectiveness  at  any  prescribed  level  of  cost.  Conversely,  to  achieve  a pre- 
scribed level  of  effectiveness,  the  DSPCE  methodology  defines  the  system,  the  sys- 
tem configuration,  and  the  associated  cost  to  achieve  that  effectiveness. 

C.  DSPCE  APPLIED  TO  TARGET  ACTIVATED  MUNITIONS 

The  DSPCE  methodology  will  be  applied  to  the  hypothetical  mine  which  was  con- 
sidered in  the  previous  sections.  Suppose  there  are  three  warhead  options  which 
directly  influence  system  effectiveness.  These  three  warhead  options  are  listed 
In  Table  20. 
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Table  20 
WARHEAD  OPTIONS 


•‘  V'.; 


WARHEAD 

OPTION 

KILL  PROBABILITY 
OF  WARHEAD 

Pk 

COST  ($) 

1 

.4 

8.00 

2 

.6 

12.00 

3 

.9 

18.00 

. 

* * * l 

The  kill  probabilities  in  the  table  are  conditional  probabilities,  l.e.,  the 
probability  of  killing  the  target  given  that  the  target  is  within  ranqe  and  the 
mine  is  operative.  These  3 warhead  options  together  with  the  subsystem  options 
listed  in  Table  14  on  page  79  lead  to  972  possible  mine  configurations,  each  with 
a certain  effectiveness  and  cost.  The  measure  of  effectiveness  to  be  used  is  the 
probability  that  a single  mine  Is  operative  and  Its  warhead  destroys  a target  that 
comes  within  range,  l.e.,  MCSP  x P^.  This  measure  Is  the  everyday  languaqe  of 
the  project  enqineer  and  allows  him  to  apply  the  DSPCE  methodology  on  a daily 
basis.  This  measure  also  plays  an  important  role  in  any  more  detailed  effective- 
ness analyses  dealing  with  such  additional  considerations  as  delivery  modes,  mine 
field  density,  tactics,  etc. 

Let  System  consist  of  Warhead  1 together  with  the  remaining  mine  sub- 
systems listed  in  Table  1,  page  33, with  subsystem  reliability  options  defined  In 
Table  14,  page  79.  Let  System  S2  be  defined  similarly  with  the  exception  that  War- 
head 2 is  used,  and  for  System  S3  Warhead  3 is  used.  If  the  warhead  Is  fixed, 
then  system  effectiveness  improvements  can  only  come  from  reliability  Improvements 
of  the  subsystems,  fhe  subsystem  reliability  options  are  defined  In  Table  14. 

From  these  options,  the  DSPC  results  listed  In  Table  15  were  derived  which 
defines  10  optimal  vertex  points  of  the  MCSP  versus  cost  curve.  For  a fixed  Pk, 
the  optimal  effectiveness  (MCSP  x Pk)  versus  cost  curve  Is  obtained  by  multiplying 
the  MCSP  at  each  vertex  point  of  Table  15  by  Pk  and  addlnq  the  cost  of  the  warhead 
under  consideration.  Applying  this  procedure  with  Systems  S- , S2,  and  S3  defined 
above  yields  the  effectiveness  results  listed  In  Table  21  for  the  three  warhead 
options. 
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Table  21 

OPTIMAL  EFFECTIVENESS  FOR  THREE  WARHEAD  OPTIONS 


SYSTEM 

1 

SYSTEM  2 

SYSTEM  3 

VERTEX 

(Warhea 

d 1) 

(Warhead  2) 

(Warhead  3) 

POINT 

MCSP  x Pk 

UNIT 

UNIT 

UNIT 

COST 

MCSP  x Pk 

COST 

MCSP  x p, 
k 

COST 

1 

.11 

207.50 

.17 

211.50 

.25 

217.50 

2 

.14 

208.25 

.20 

212.25 

.31 

218.25 

3 

.16 

208.75 

.23 

212.75 

.35 

218.75 

4 

.18 

209.75 

.27 

213.75 

.41 

219.75 

5 

.21 

211.25 

.31 

215.25 

.47 

221.25 

6 

C\J 

CM 

• 

212.75 

.34 

216.75 

.50 

222.75 

7 

.24 

214.75 

.36 

218.75 

.54 

224.75 

8 

.26 

217.25 

.40 

221.25 

.59 

227.25 

9 

.27 

219.25 

.41 

223.25 

.61 

229.25 

10 

i— 

.28 

221.25 

.42 

225.25 

.63 

231 .25 

The  table  shows,  for  instance,  that  vertex  point  3 for  System  2 yields  a 
higher  effectiveness  at  the  same  cost  as  vertex  point  6 for  System  1 . The 
results  of  Table  21  are  plotted  in  Fiqure  13  which  clearly  show  which  warhead 
is  preferred  at  various  levels  of  cost.  The  optimal  effectiveness  versus  cost 
curve  Is  depicted  by  the  vertex  points  on  the  solid  curve.  The  dashed  sections 
are  nonoptimal  but  show  the  effectiveness  if  the  Proqram  Manager  were  restricted 
to  use  only  one  of  the  three  warheads.  The  optimal  combination  of  subsystem 
options  correspondino  to  each  vertex  point  in  Figure  13  is  defined  in  Table  22. 
Of  the  972  possible  mine  configurations,  955  are  nonoptimal,  i.e.,  yield  points 
below  the  DSPCE  curve. 

The  results  in  Table  22  can  be  used  to  show  the  consequences,  in  terms  of 
effectiveness,  of  purchasing  fewer  more  effective  mines  while  maintaining  ft 

fixed  program  cost  of  $20M.  The  discussion  would  be  analogous  to  that  of  Table 
16  on  page  77. 
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Table  22 

OPTIMAL  OSPCE  CONFIGURATIONS  FOR  MINE  EXAMPLE 


0 


VERTEX 

POINT 

CONFIGURATION 

(SUBSYSTEM  OPTIONS) 

PROBABILITY 

MINE 

UNIT 

COST 

FIN 

BRAKE 

CUTTER 

BODY 

SAFE  & ARM  WARHEAD 

DESTROYS 

TARGET 

1 

0 

0 

1 

0 

0 

1 

.11 

207.50 

2 

2 

0 

1 

0 

0 

1 

.14 

208.25 

3 

2 

1 

1 

0 

0 

1 

.16 

208.75 

4 

3 

1 

1 

0 

0 

1 

.18 

209.75 

5 

3 

2 

1 

0 

0 

1 

.21 

211.25 

6 

2 

1 

1 

0 

0 

2 

.23 

212.75 

7 

3 

1 

1 

0 

0 

2 

.27 

213.75 

8 

3 

2 

1 

0 

0 

2 

.31 

215.25 

9 

3 

2 

1 

0 

1 

2 

.34 

216.75 

10 

3 

2 

1 

1 

1 

2 

.36 

218.75 

11 

3 

1 

1 

0 

0 

3 

.41 

219.75 

12 

3 

2 

1 

0 

0 

3 

.47 

221.25 

13 

3 

2 

1 

0 

1 

3 

.50 

222.75 

14 

3 

2 

1 

1 

1 

3 

.54 

224.75 

15 

3 

2 

2 

1 

1 

3 

.59 

227.25 

16 

3 

2 

2 

2 

1 

3 

.61 

229.25 

17 

3 

2 

2 

2 

2 

2 l 

.63 

231.25 

D.  CONCLUSION 

I 

Tins  section  has  presented  the  development  of  the  OSPCE  methodology  along  with 
an  example  of  the  application  of  the  methodology.  The  DSPCE  methodology  analyzes 
effectiveness  as  well  as  reliability  to  identify  the  combination  of  subsystem  op- 
tions yielding  the  maximum  effectiveness  at  any  prescribed  cost. 
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In  the  next  section,  the  management  tools  developed  in  the  previous  sections 
a-e  summarized,  and  data  requirements  and  availability  for  Implementing  the  models 
are  briefly  discussed. 
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SECTION  VI 


SUMMARY 


This  handbook  has  presented  methodologies  designed  to  provide  a Program 
Manager  with  analytic  tools  for  solving  a multitude  of  problems  encountered  in 
the  course  of  system  development.  Briefly  stated,  these  management  tools  allow 
for  continuous  and  systematic: 

• Evaluation  of  overall  system  reliability  (MCSP). 


The  MCSP  model  determines  the  probability  that  a system  completes  its 
mission  without  being  degraded  below  acceptable  limits  because  of  a critical 
failure  of  one  tfr  more  of  its  subsystems.  MCSP  models  can  also  be  used  to 
identify  the  critical  subsystems  and  show  the  overall  system  MCSP  enhancement 
due  to  reliability  improvement  of  one  or  more  critical  subsystems. 

• Optimal  allocation  of  resources  in  system  reliability  improvement 
Programs  (DSPC). 

The  DSPC  model  can  be  employed  during  the  conceptual  phase  or  very 
early  in  the  development  phase  to  select  the  initial  or  Baseline  System  Con- 
figuration from  among  competing  subsystems,  or  it  can  be  applied  later  in  the 
development  process  if  a reliability  improvement  program  is  undertaken. 

• Optimal  allocation  of  resources  in  system  effectiveness  improvement 


When  options  in  the  form  of  varying  levels  of  effectiveness  and  the 
cost  associated  with  each  level  are  available,  the  DSPC  methodology  can  be 
Implemented  to  determine  that  combination  of  subsystem  options  yielding  the 
maximum  system  effectiveness  at  any  prescribed  cost.  However,  it  goes  without 
saying  that  the  decision-making  information  provided  by  these  methodologies  can 
only  be  as  good  as  the  data  that  is  input.  Therefore,  the  importance  of  a valid 
data  base  cannot  be  over  emphasized.  If  for  certain  programs  the  data  base  is 
not  available,  or  if  the  quality  of  the  data  is  suspect,  steps  should  be  taken 
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Irmediately  to  establish  the  necessary  data  base,  or  make  the  necessary  Improve- 
ments. This  is  particularly  true  for  applications  of  the  methodologies  during 
the  conceptual  and  definition  phases  of  system  development.  Once  testing  begins, 
the  necessary  data  can  be  collected  In  conjunction  with  the  test  program.  The 
type  of  data  required  to  Implement  the  various  models  Is  clearly  illustrated  In 
the  various  examples  presented  in  this  handbook.  Thus,  anyone  desiring  to 
utilize  the  methodology  can  readily  see  the  exact  nature  of  the  data  required 
and  taka  the  necessary  steps  to  acquire  this  data.  The  methodologies  presented 
In  this  handbook  allow  the  Program  Manager  to  evaluate  his  system  and  make 
optimal  decisions  based  upon  a constantly  improvinq  data  base.  Without  the 
required  data,  decisions  can  only  be  based  upon  intuition  or  past  experience. 
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Reference  7 contains  a tabulation  of  various  data  sources  which  could 
provide  valid  inputs  for  a wide  range  of  applications  of  the  methodology 
presented  in  this  handbook.  Reference  8 contains  a similar  tabulation. 
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